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I.  Introduction 


We  have,  in  the  past  27-month  period,  completed  several  major  tasks  of  our  research  on  hybrid 
optical  processor  programs.  Our  tasks  were  completed  in  a  manner  consistent  with  proposed 
research  programs  supported  by  the  United  States  Air  Force,  Rome  Air  Development  Center 
at  Hanscom  Air  Force  Base,  under  contract  number  F19628-87-C-0086.  Results  have  been 
published,  in  part,  in  technical  literature  and  have  been  presented  at  scientific  conferences. 

Copies  of  these  papers  are  included  in  this  report  to  provide  concise  documentation  of  our  research 
efforts.  In  the  following  sections,  we  shall  give  an  overview  of  our  research  work  done 
during  the  period  1  July  1987  to  30  July  1990.  Publications  resulting  from  this  effort  are  included 
at  the  end  of  this  report  as  appendices. 


II.  Summary  and  Overview 


Recent  advances  of  programmable  spatial  light  modulators  (SLM)  have  permitted  the  synthesis  of 
hybrid  signal  processors  for  various  computational  needs.  In  accordance  with  this  research 
program  we  have  developed  and  synthesized  various  types  of  hybrid  optical  uchitectures  capable 
of  performing  tasks  such  as:  multiple  matrix  computation,  hybrid  optical  computing,  optical  binary 
adder,  optical  perfect  shuffle,  application  of  associative  memory  to  symbolic  substitution,  acousto 
optic  joint  transform  correlator  for  space  integration  and  frequency  shift  keying  applications,  hard 
clipping  joint  transform  correlator,  and  programmable  multi-channel  optical  correlator  for  automatic 
scanning  image  detection.  The  basic  architecture  of  these  hybrid  optical  processors  is  a 
microcomputer-based  design  utilizing  various  types  of  spatial  light  modulators.  The  configuration 
of  these  hybrid  optical  architectures  and  discussion  of  the  operation  of  these  systems  are  presented. 
The  performance  of  this  research  program  is  consistent  with  the  proposed  research  programs 
supported  by  the  United  States  Air  Force,  Rome  Air  Development  Center  at  Hanscom  Air  Force 
Base  under  contract  number  F19628-87-C-0086. 
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2.1  Hybrid  Processor  for  Multiple-Matrix  Multiplication 


We  have  developed  two  hybrid  optical  architectures  to  perform  multiple  binary-matrix 
multiplication  [1].  These  architectures  include  microcomputers  and  programmable  spatial  light 
modulators.  We  have  used  both  the  inner-product  and  systolic-inner-product  methods  for  multiple 
binary  number  and  multiple  matrix  multiplication.  In  the  first  architecture  the  inner-product  method 
is  used  to  carry  out  multiple-matrix  multiplication.  Figure  1  shows  a  hybrid  optical  system  which 
is  able  to  carry  out  a  triple  binary  number  multiplication  operation.  Three  magnito-optic  spatial 
light  modulators  serve  as  the  inputs.  A  CCD  detects  the  result  and  feeds  back  to  a  high  speed 
memory.  In  this  system,  the  multiplication  is  performed  by  binary  transmittance  of  the  SLM's,  and 
the  sum  is  carried  out  by  focusing  the  light  onto  the  detector.  The  introduction  of  grating  masks 
into  this  architecture  permits  a  fully  parallel  matrix  multiplication  through  separation  of  the  output 
vectors. 

The  second  architecture  is  a  combination  of  the  inner-product  and  systolic  array  arrangement 
techniques.  This  architecture  is  capable  of  performing  large  matrix  multiplication  and  has 
applications  in  linear  and  bilinear  transformations.  In  this  system  the  binary  number  matrix 
representation  in  the  SLM's  can  be  shifted  step-by-step  for  the  systolic  array  arrangement.  Thus, 
matrix  multiplication  can  be  performed  using  this  system  with  the  major  drawback  being  the  speed. 
For  example,  a  2x2  matrix  multiplication  requires  four-step  operation.  By  decomposing  the 
matrices  and  then  applying  the  systolic-inner-product  method,  substantial  reduction  in  the  size  of 
the  SLM's  is  possible.  We  have  carried  out  preliminary  experimental  demonstration  of  these 
techniques.  In  addition,  since  these  techniques  are  either  mixed  binary  or  binary  representation, 
the  hybrid  optical  processors  would  offer  high  accuracy  with  moderate  speed  for  multiple  matrix 
computation. 
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Plane  SLM1  CL1  CL2  SLM2  CL3  CL4  SLM3  CCD 
Wave  Camera 


Figure  1.  A  hybrid  optical  processor  for  optical  computing.  SLM1-SLM3,  spatial  light 
modulators;  CLi*CL4,  cylindrical  lenses;  Li  and  L2,  lenses;  SL1-SL2,  spherical  lenses. 

2.2  Hybrid  Qptigjd  CQmpyflng 

We  have  developed  several  hybrid  optical  processors  utilizing  transparent  SLM's  for  digital  optical 
computing  [2].  We  have  shown  that  digital  matrix  multiplication  (see  Figure  2),  symbolic  logic 
processing  (see  Figure  3),  and  linear  transformation  (see  Figure  4)  can  be  performed  with  these 
hybrid  architectures.  Since  MOSLM  can  be  addressed  in  partial  parallel  mode,  the  whole  frame 
pattern  on  MOSLM  can  be  switched  in  a  very  rapid  manner,  for  example,  6.4  |is  for  a  64  x  64 
MOSLM;  51.2  (is  for  a  512  x  512  MOSLM.  By  utilizing  a  high  speed  memory  subsystem  with  a 
specially  designed  interfacing  circuit  (the  technology  is  available)  a  relatively  slow  microcomputer 
can  be  used  to  manipulate  the  parallel  operation  of  MOSLM's.  This  is  known  as  single  instruction 
multiple  data  (SIMD)  operation.  In  addition,  with  the  introduction  of  a  microcomputer  into  the 
system,  a  man-machine  communication  link  is  also  provided.  To  generate  the  systolic  array 
formats  rapidly,  a  table  look  up  instruction  is  suggested.  After  the  time  integrating  CCD  detector,  a 
high  speed  analog  to  digital  converter  (ADC)  and  a  serial-parallel  deformater  would  be  used. 

Thus,  by  exploiting  the  programmability  of  the  computer,  various  linear  algebraic  operations  can 
be  performed  with  this  hybrid  optical  architectures. 
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Finally,  by  exploiting  the  efficient  operation  of  the  optics  and  the  programmability  of  the  electronic 
computer,  it  is  our  belief  that  hybrid  optical  architecture  would  be  the  logical  approach  toward 
modem  optical  computing.  However,  much  remains  to  be  done  in  the  development  of  electro- 
optical  devices  before  the  hybrid  optical  computing  can  become  a  widespread  practical  reality. 


Light  source  LI  PI  P2  L2  Sinusoidal  L3  Image 

Grating  Detector 


Figure  2.  An  electro-optical  processor.  L’s-lenses;  P's-polarizers. 
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Figure  3.  An  electro-optical  symbolic  logic  processor.  L's-lenses. 
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Figure  4.  An  electro-optical  discrete  linear  transformation  processor.  L's-lenses;  P's-polarizers. 
2.3  Optical  Perfect  Shuffle 

One  of  the  inherent  advantages  of  the  optical  computer  is  its  noninteractive  connecting  capability. 
The  optical  perfect  shuffle  (PS)  which  forms  the  basis  of  such  an  interconnect  network  is  a  useful 
concept  in  optical  computer  architecture.  We  have  demonstrated  that  two  sets  of  data  can  be 
shuffled  using  an  optical  spatial  filter  [3].  Figure  5  shows  the  optical  perfect  shuffle  set-up.  Two 
sets  of  data  are  designated  by  S 1  and  S2,  which  are  separated  by  2B  at  the  input  plane.  With 
coherent  light  illumination,  the  complex  light  distribution  which  includes  the  Fourier  spectra  of  the 
input  data  appears  in  the  Fourier  plane.  To  implement  perfect  shuffle,  a  sinusoidal  grating  is  placed 
in  the  Fourier  plane. 

In  the  experiment,  we  used  two  sets  of  English  letters  as  input  data.  Figure  6(a)  shows  the  input 
data  and  Figure  6(b)  gives  the  shuffled  data  obtained  with  the  proposed  system.  We  have  noted 
that  perfect  shuffle  can  also  be  achieved  if  two  optical  processors  are  arranged  in  tandem.  In  this 
case  the  perfect  shuffle  operation  can  be  applied  to  a  2-D  data  array,  such  that  one  shuffles 
horizontally  and  the  other  vertically.  The  generalized  perfect  shuffle  with  its  large  data  handling 
capacity  might  be  a  viable  trade-off  for  certain  applications. 
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2.4  Optical  Binary  Adder 


We  have  demonstrated  a  method  of  building  an  optical  half  adder  using  a  programmable  LCTV  [4], 
This  optical  half  adder  is  capable  of  performing  the  XOR,  AND,  NOT,  and  OR  logical  operations. 
Experimentally,  we  have  shown  that  a  4-bit  half-addition  can  be  obtained.  Figure  7  shows  the  set¬ 
up  for  4-bit  parallel  half-adder.  The  optical  half  adder  can  be  easily  extended  to  perform  larger- 
array-numbers  addition,  by  simply  changing  the  computer  program  of  microcomputer.  We  note 
that  no  extra  coding  is  required  in  the  half-adder,  since  the  number  was  automatically  encoded  by 
LCTV.  To  extend  a  half  adder  to  perform  a  full-adder  operation  we  introduce  an  optical  read  only 
memory  for  carry  transmission  and  overflow  error  detection.  An  optical  architecture  of  a  2-bit  full 
adder  using  an  OROM  is  also  proposed. 


Figure  5.  Optical  perfect  shuffle  system:  SI  and  S2,  input  data;  LI  and  L2  lenses;  H,  Filtering 

grating. 
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Figure  6(a).  Input  data  to  optical  perfect  shuffle  architecture. 
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Figure  6(b).  The  Shuffled  version  of  the  input  data. 
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Figure  7.  An  optical  set-up  for  4-bit  parallel  half-adder.  A,  B,  inputs;  Ml,  M2,  mirrors;  PI,  P2, 

P3,  polarizers. 


2.5  Application  of  Associative  Memories  to  Symbolic  Substitution 

We  have  demonstrated  a  technique  of  spatial  modulation  to  implement  symbolic  substitution  logic 
using  one-step  holographic  associative  memories  [5].  The  spatial  modulation  technique  gives  more 
flexibility  in  the  filter  synthesis  than  the  multiplexing  technique  since  the  hologram  has  a  limited 
dynamic  range.  We  have  demonstrated  a  simple  example  of  multi-instruction  multi-data  (MIMD) 
operation,  i.e.,  parallel  half  addition.  By  utilizing  real-time  spatial  light  modulators  such  as  LCLV, 
LCTV,  MOSLM,  a  full  addition  may  be  realized  by  multistep  substitution.  If  the  final  cross 
correlation  can  be  totally  eliminated,  the  proposed  method  may  be  superior  sampling  technique, 
since  this  method  is  fully  space  invariant 

2.6  Acousto-Optic  Space  Integrator 

We  have  developed  an  architecture  for  a  real-time  space  integrating  correlator  based  on  the  optical 
joint  transform  correlator  [6].  Two  parallel  on-plane  AO  cells  are  employed  to  convert  electrical 
signals  into  acoustic  strain  fields.  A  transform  lens  produces  the  joint  transform  of  the  optical 
pattern  induced  by  the  acoustic  strain  fields.  A  square  law  converter,  e.  g. ,  a  liquid  crystal  light 
valve  (LCLV),  can  extract  the  joint  transform  power  spectrum.  The  inverse  Fourier  transform  of 
the  coherent  readout  of  the  square  law  converter  provides  the  cross  correlation  of  the  input  signals. 

Since  two  AO  cells  are  on  the  same  plane,  the  proposed  architecture  can  be  implemented  in  a 
compact  system  (see  Figure  8).  A  simple  experiment  utilizing  an  LCTV  as  square-law  converter 
and  applying  a  65  MHZ  pure  sinusoidal  signal  (for  simplicity)  to  the  input  cells  was  conducted. 
Figure  9  shows  the  output  correlation  peaks  obtained  with  the  set-up  of  Figure  8,  with  the 
separation  between  the  two  AO  cells  being  12  mm.  By  addition  of  an  adequate  number  of  AO  cells 
on  the  input  plane,  this  architecture  can  easily  be  extended  to  a  system  that  yields  more  than  two 
cross-correlations.  At  the  output  plane,  we  obtain  spatially  separated  cross-correlation  functions 
that  correspond  to  the  AO  cells.  The  correct  positioning  of  the  AO  cells  in  the  input  plane  will 
prevent  the  correlation  distribution  from  overlapping  each  other.  The  three  cell  system  may  be 
sufficient  for  a  digital  communication  system  in  which  two  different  waveforms  are  selected  for 
transmission  to  the  receiver.  This  feature  is  important  for  digital  communication  in  which  different 
waveforms  are  used  to  represent  different  messages. 
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2.7 


We  have  developed  a  multi-channel  acousto-optic  space  integrator  for  modulated  frequency  shift 
keying  (MFSK)  signal  detection  [7]  as  shown  in  Figure  10.  This  system  consists  of  an  array  of 
AO  cells  at  the  input  plane  and  a  liquid  crystal  light  valve  as  the  square-law  detector  for  the 
composite  Fourier  to  power  spectrum  conversion.  In  principal  this  hybrid  optical  processor  is 
capable  of  processing  very  wide  bandwidth  temporal  signals,  as  high  as  106  resolution  elements. 
The  proposed  AO  correlator  can  be  synthesized  in  compact  form.  One  of  the  requirements  of  the 
proposed  system  is  the  availability  of  a  square  law  converter  with  both  high  speed  and  large 
dynamic  range.  Thus  the  realization  of  this  architecture  depends  upon  development  of  the 
necessary  components. 


Coherent  Input 

light  plane 


Coherent  Output 

I'Qht  plane 


S  L3 


Figure  8.  Optical  setup  for  an  acousto-optic  signal  correlator.  AOl  and  A02-cells;  LI  and  L2- 
transform  lenses;  L2  and  L4-magnifing  lenses;  S-square-law  converter,  BS-beam  splitter. 


Figure  9.  The  output  correlation  peaks  obtained  with  the  set-up  of  Figure  1. 
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Coherent  Input 

light  plane 


Figure  10.  Multicell,  multifrequency  acousto-optic  joint  transform  correlator:  AOo-n-i»  acousto¬ 
optic  cells:  LI  and  L3  transform  lenses:  L2  and  L4  magnification  lenses:  S,  square-law  converter: 

BS,  beam  splitter:  F,  spatial  filter  G,  grating. 

2.8  Hard-Clipping  Joint  Transform  Correlator 

Because  of  its  high  speed  and  structural  simplicity,  the  optical  joint  transform  correlator  is 
proposed  for  application  to  pattern  recognition.  We  have  developed  a  real-time  programmable 
hybrid  joint  transform  correlator  utilizing  the  threshold  hard-clipping  properties  of  a  microchannel 
spatial  light  modulator  (MSLM)  [8].  In  the  system,  an  MSLM  is  utilized  as  the  threshold  hard- 
clipping  device  and  a  liquid  crystal  television  (LCTV)  is  used  as  the  input  and  reference  images. 

By  using  the  feed-back  loop,  as  depicted  in  Figure  1 1,  the  system  offers  the  adoptive  processing 
capability. 

The  LCTV  is  used  to  display  a  real-time  target  and  a  reference  image  at  the  input  plane  of  an  optical 
processor.  The  main  advantage  of  LCTV  is  its  programmability  for  the  generation  of  different 
reference  images.  The  lens  system  L1-L3  is  employed  to  demagnify  the  input  object  images  from 
the  LCTV  to  an  appropriate  size  and  then  transform  onto  the  MSLM.  The  output  is  detected  by  a 
CCD  camera  and  it  can  be  fed  back  to  the  microcomputer  for  further  operation  making  the  system 
an  adaptive  hybrid  electro-optic  correlator. 


1 1 


To  compare  the  performance  of  the  real-time  programmable  JTC  over  the  existing  JTC  techniques, 
with  regard  to  the  intensity  of  the  correlation  peaks,  a  theoretical  analysis  of  the  two  system  has 
been  carried  out  Equations  1  and  2  show  the  autocorrelation  function  distribution  at  the  output 
plane  for  the  conventional  system  and  the  real-time  programmable  JTC  respectively. 


g(x,y)  =  -  A 


X  -L 
co 


^)JO 


(l) 


A  f  sin[tt(X  -  L)/co]  sin[rc(X  +L)/co]  1  sin(;cY/G>)  p 

*1  jt(X-L)  +  ji(  X  +  L)  J  rcY 

Where  A  is  the  illumination  amplitude,  and  A  represents  a  triangular  function,  we  see  that  the 
correlation  peak  intensity  of  the  proposed  system  is  about  A^/Tt^U4,  whereas  for  the  conventional 
JTC  it  would  be  A2/16lJ4.  In  other  words,  the  correlation  peak  intensity  of  the  proposed  system 
would  be  about  1.62  times  higher  than  that  of  the  conventional  system.  In  addition,  if  the  bias 
voltages  can  be  controlled  such  that  the  threshold  hard-clipping  takes  place  at  a  lower  intensity  level 
to  include  the  whole  main  lobe,  it  can  be  shown  that  the  peak  intensity  function  is  16A2/7t2U4, 
which  is  26  times  higher  than  the  classical  JTC.  The  autocorrelation  function  distribution  at  the 
output  plane  for  this  system  is  shown  in  Equation  3. 

A  I"  sin[27t(X  -L)/co]  sin[2ft(X  +L)/co]  "I  sin(27tY/co)  n 
b  ~  71  L  rt(X-L)  +  Jt(X+L)  J  JtY 

It  should  be  mentioned  that,  if  the  threshold  hard-clipping  values  are  further  controlled  to  include 
the  first  side  lobes,  the  output  correlation  intensity  could  be  further  increased. 

By  combining  the  advantages  of  the  state-of-the-art  electro-optic  devices  and  the  flexibility  of  a 
microcomputer,  this  technique  overcomes  the  common  drawback  of  the  existing  methods,  namely, 
low  correlation  peak  intensity  compared  to  the  illumination  intensity  hence  producing  sharper 
autocorrelation  peaks.  We  stress  that  this  JTC  can  produce  sharper  and  higher  correlation  intensity 
than  conventional  JTC. 
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LCTV  LI  L2  L3  BS  L4  CCD  Camera 


TV  Camera 


Figure  11.  The  Schematic  of  a  programmable  hard-clipping  joint  transform  correlator:  L's- 

Lenses;  BS-polarizing  beam  splitter. 


We  have  developed  a  programmable  scanning  optical  correlator  using  a  low  cost  liquid  crystal 
television  (LCTV)  [9].  The  imposition  of  a  scanning  grating  on  an  LCTV  screen  with  a  micro¬ 
computer  will  alleviate  the  positioning  problem  associated  with  the  mechanical  scanning  method  for 
large  capacity  correlator  systems,  as  shown  in  Figure  12.  The  positioning  difficulty  can  be  caused 
by  either  movement  or  the  frequency  shift  in  the  mechanical  scanning  techniques.  The  low 
resolution  of  LCTV  which  limits  spatial  carrier  frequency  is  overcome  by  using  a  new  set-up 
which  is  different  from  a  conventional  optical  correlator.  The  lenses  L2  and  L3  are  used  to  project  a 
reduced  image  of  the  LCTV  grating  onto  the  input  plane  of  the  optical  correlator,  so  that  the  Fourier 
transform  of  the  object  can  be  in  a  proper  scale  while  the  spatial  frequency  of  the  spectrum  of  the 
grating  is  magnified.  The  different  diffraction  orders  on  the  frequency  plane  can  therefore  be 
sufficiently  separated. 
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We  set  adjustable  delays  between  the  subroutines,  longer  delays  for  filter  construction  and  shorter 
delays  for  target  detection.  In  order  to  multiplex  matched  filters  onto  a  recording  plate,  we  would 
rotate  the  grating  one  at  a  time.  While  an  input  image  is  being  recognized,  the  orientation  of  the 
grating  is  automatically  changed  according  to  the  instruction  received  from  the  microcomputer.  As 
soon  as  the  auto-correlation  peaks  appears  at  the  output  plane,  the  scanning  is  terminated, 
otherwise  continued.  Using  a  multi-channel  spatial  filter  of  eight  input  objects  which  were  recorded 
on  a  holographic  plate  and  observation  of  the  corresponding  output  correlation  peaks  we  have 
concluded  that  a  multi-channel  correlating  operation  can  be  achieved  using  a  programmable  LCTV 
grating. 

The  scanning  speed  of  the  proposed  correlator  is  primarily  limited  by  the  microcomputer  and  the 
response  time  of  the  LCTV.  Furthermore,  if  a  higher  resolution  LCTV  is  available,  both  the  input 
object  and  the  modulating  grating  can  be  superimposed  onto  the  LCTV  screen.  Thus  a 
programmable,  real-time,  electrically  addressed  correlator  may  be  realized. 
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Figure  12.  A  multi-channel  optical  correlator  using  an  addressed  LCTV.  Li  and  L2,  collimating 
system;  L3  and  L5,  transform  lenses;  L3,  magnifying  lens;  Pi  and  P2,  polarizers;  BS,  beam 

splitter,  M,  mirror 
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2.10  White-Light  Pseudocolor  Encoding 


Pseudocolor  encoding  is  a  commonly  used  enhancement  for  grey  level  images.  We  have  in 
this  period  of  research  developed  a  two-step,  three-color,  white-light  pseudocolor  encoding 
process.  A  variation  of  this  three  color  encoding  method  uses  moire  fringe  patterns  from 
two  encodings  to  carry  the  information  previously  obtained  from  the  third  encoding.  By 
using  this  new  procedure,  the  pseudocolor  encoding  was  accomplished  using  a  single 
sampling  grating,  and  two  rather  than  three  exposures.  This  allows  greater  use  of  the 
dynamic  range  of  the  film  by  eliminating  one  exposure.  This  method  also  illustrates  an 
interesting  application  of  moire  patterns. 

2. 1 1  Phase  Conjugation  Joint  Transform  Correlator 

In  this  period  of  research,  several  applications  of  phase  conjugation  technique  in  a  JTC 
have  been  investigated.  It  is  shown  that  phase  distortion  in  the  input  objects  (due  to  SLM) 
in  a  coherent  image  processing  system  can  be  efficiently  compensated  by  using  the  phase 
conjugation  technique.  The  additional  amplitude  or  phase  modulations  produced  by  the 
nonlinearity  of  phase  conjugation  can  be  utilized  to  pre-encode  the  object  functions,  for 
which  correlation  characteristics  can  be  improved.  Computer  simulations  indicate  that 
phase  pre-encoded  objects  improve  the  accuracy  of  correlation  detection,  which  results 
from  smaller  autocorrelation  spots  and  lower  cross  correlation  intensity.  This  encoding 
technique  would  find  application  in  the  research  of  dynamic  pattern  recognition  and  robotic 
vision. 
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2.12 


We  have  developed  a  novel  method  for  obtaining  the  phase  distribution  of  an  object 
spectrum  by  using  a  fringe-scanning  phase-conjugate  interferometer.  A  detailed  analysis  of 
the  proposed  technique  is  provided,  and  experimental  demonstrations  for  validating  this 
technique  are  also  given.  The  major  advantages  of  this  method  are  its  potentially  high 
accuracy  and  its  low  space-bandwidth-product  requirement  for  the  detection  system. 
Moreover,  using  the  fringe-scanning  method,  the  factors  to  be  multipled  are  fixed  to  only  a 
few  values.  Instead  of  performing  real-time  multiplications,  one  can  use  a  data  look-up 
table  to  speed  up  the  computational  process.  Moreover,  the  spectral  content  of  the  object  in 
the  Fourier  plane  is  concentrated  mostly  in  some  specific  regions.  It  is  generally  not 
necessary  to  compute  the  phase  distribution  over  the  entire  nxn  points.  In  other  words,  the 
computation  can  be  selected  based  on  the  spectral  intensity  distribution;  thus  the  amount  of 
computational  time  can  be  substantially  reduced. 


We  have  shown  in  the  period  of  research  that  optical  symbolic  logic  operation  can  be  easily 
achieved  with  cascaded  low-cost  LCTVs.  Aside  from  the  basic  16  logic  operations,  we 
have  shown  that  the  same  processor  can  perform  any  two-level  logic  function.  Major 
limitations  on  using  LCTV  must  be  the  low  resolution,  low  contrast,  low  speed  and  low 
transmittance,  which  prevent  widespread  practical  applications.  Nevertheless,  the  low  cost 
and  programmability  of  the  LCTV  would  stimulate  some  interest  in  the  application  of 
symbolic  logic  processing.  Since  the  digital  computation  can  be  divided  into  a  series  of 
specific  logic  functions,  perhaps  some  specialized  digital  uniprocessors  may  be 
implemented  based  on  this  proposed  optical  processor. 
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2.14  Joint  Fourier  Transform  Processor 


In  this  phase  of  research,  we  have  shown  that  a  joint  Fourier  transform  processor  can  be 
used  as  a  conventional  coherent  optical  processor.  In  principle,  the  joint  transform 
processor  can  perform  all  the  optical  data  processing  that  a  conventional  coherent  optical 
processor  can  offer.  Sample  illustrations  for  signal  extraction  and  image  subtraction  are 
given.  The  major  advantages  of  the  joint  transform  processor  must  be  ( 1)  the  avoidance  of 
synthesizing  a  matched  spatial  filter,  (2)  higher  space  bandwidth  product,  (3)  lower  spatial 
carrier  frequency  requirement,  (4)  higher  output  diffraction  efficiency,  etc. 

2.15  Holographic  Associative  Memory  Using  a  MicroChannel  Spatial  Light  Modulator 

We  have,  in  this  research  program,  investigated  a  holographic  associative  memory  system 
with  a  controllable  MSLM.  Since  the  MSLM  is  used  as  an  active  device  in  the  system  ,  the 
quality  of  the  output  addressed  data  can  be  improved  as  compared  with  a  passive 
holographic  method.  Another  advantage  of  the  system  is  its  controllability,  by  which  the 
memory  addressing  mode  can  be  adjusted  to  either  "winner-take-all"  or  "weighted  sum" 
operations.  The  joint  transform  method  has  the  merit  of  easy  system  alignment  and  real¬ 
time  filter  synthesis.  It  is  apparent  that  if  programmable  spatial  light  modulators  were  used 
at  the  input  plane  Pi  and  the  holograph  plane  P>  and  a  feedback  loop  was  consructed 
between  them,  the  memory  capacity  of  the  system  could  be  further  enhanced. 

2.16  A  Hybrid-Optical  lieural  Network 

In  this  research  program,  we  have  developed  a  2-D  hybrid  optical  neural  network  using  a 
high  resolution  video  monitor  as  a  programmable  associative  memory.  Experiments  and 
computer  simulations  of  the  system  have  been  conducted.  The  high  resolution  and  large 
dynamic  range  of  the  video  monitor  enable  us  to  implement  a  hybrid  neural  network  with 
more  neurons  and  more  accurate  operation.  The  system  operates  in  a  high  speed 
asynchronous  mode  due  to  the  parallel  feedback  loop.  The  programmability  of  the  system 
permits  the  use  of  orthogonal  protection  and  multilevel  recognition  algorithms  to  increase 
the  robustness  and  storage  capaciity  of  the  network. 
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2.17  Optical  Disk  Based  Neural  Network 


We  have,  in  this  period  of  research,  proposed  a  technique  for  using  an  optical  disk  as  a 
large  capacity  associative  memory  in  an  optical  neural  network  which  will  be  described. 

There  are,  however,  several  problems  that  should  be  addressed  before  constructing  the 
optical  disk  based  neural  network. 

The  readout  head  has  to  be  redesigned  for  reading  the  whole  block  of  an  IWM  rather  than 
sequential  readout  techniques* 

The  existing  SLM  still  cannot  meet  the  processing  speed  of  the  proposed  system  (i.e.,  ~109 
Hz).  However,  the  optical  disk  based  neural  network  is  suitable  for  applications  to  a  huge 
database  associative  search,  which  does  not  require  a  frequent  change  of  input  patterns. 

The  electronic  bottleneck  in  the  feedback  loop  may  be  alleviated  to  some  extent  by  using 
parallel  buffers.  However,  a  decision-making  circuit  for  postprocessing  the  output  data  in 
2-45us  has  to  be  developed. 

Nevertheless,  the  proposed  optical  disk  based  neural  network  offers  a  large  capacity 
associative  database  for  which  high  speed  operation  can  be  achieved. 

3.0  Conclusion 

Dove  Electronics,  Inc.  and  the  Pennsylvania  State  University  have  designed  and 
demonstrated  various  hybrid  optical  processor  architectures  for  signal/data  processing 
applications.  These  applications  include  multiple  matrix  computation,  hybrid  optical 
computing,  optical  binary  adding,  optical  perfect  shuffle,  joint  transform  correlation, 
Founer  transformation,  holographic  associative  memory,  and  hybrid  optical  neural 
network.  These  various  architectures  were  implemented  using  a  combination  of  spatial 
light  modulators  and  computers.  Some  of  these  architectures  have  immediate  operational 
potential,  while  others  require  component  development  to  increase  speed  of  operation  and 
reliability.  Follow-on  efforts  to  develop  components  and  improve  reliability  are  indicated. 
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Hybrid  optical  computing 


High  accuracy, 

Francis  T.  S.  Yu  high  data  rate, 

electro-optical  architecture 


Lightweight  and  pocket 
sized,  the  optical  signal 
processor  can  perform 
a  myriad  of  complicated 
processing  operations. 
Its  success  is  primarily  due  to  the  pro¬ 
found  diffraction  phenomena  of 
coherent  light.  The  essential  merit  of 
an  optical  signal  processor  is  its 
capability  to  process  a  signal  in  com¬ 
plex  amplitude,  parallelism,  large 
capacity,  high  speed  and  diversified 
wavelength.  Several  processing  opera¬ 
tions  have  proven  to  be  more  efficient 
with  optical  techniques  than  with  their 
electronic  counterpans.  These  opera¬ 
tions  are:  Fourier  transforms,  con¬ 
volutions,  correlation  operations  and 
spectrum  analysis.  The  major  advan¬ 
tages  of  an  electronic  computer  is  its 
flexibility,  programmability  and  easy 
accessability.  (Optical  signal  prc 
cessors  are  very  inflexible  compared 
with  electronic  computers.)  The  ques¬ 
tion  is,  “Can  we  exploit  the  efficient 
operation  of  optics  and  the  flexibility 
of  electronics  to  come  up  with  a 
realistic  electro-optical  (EO)  architec¬ 
ture  that  meets  our  computational 
needs?”  The  answer  to  this  question 
is,  “yes.” 

First,  let  me  point  out  that  the 
earlier  development  of  the  electronic 
computer  was  based  on  state-of-the- 
art  technology  available  at  that  time. 
It  was  a  very  realistic  approach  that 
we  should  adopt  for  the  development 
of  our  electro-optical  computer. 

Second,  the  current  optical  signal 
processor  can  be  regarded  as  a  highly 
efficient  processing  system  like  a  high 
performance  vehicle,  which  requires 
human  intervention  to  perform  pro¬ 
perly.  Likewise,  in  order  for  an  op¬ 
tical  signal  processor  to  function  ef- 
ficientlv,  ••  ;  need  an  electronic  com¬ 
puter  to  lend  a  hand.  The  intervention 
of  an  electronic  computer  is  not  for 
data  processing.  Rather,  its  purpose 
is  to  control  the  electro-optical  devices 


so  data  can  be  primarily  processed  by 
the  optical  processor.  Thus,  high  ac¬ 
curacy  and  high  data  rate  processing 
can  be  achieved  by  the  electro-optical 
computer. 

Digital-optical  computing 

Credit  for  the  first  optical  architec¬ 
ture  proposed  to  carry  out  matrix- 
vector  multiplication  must  be  given  to 
J.  W.  Goodman  and  his  colleagues. 
They  used  a  light  emitting  diode 
(LED)  to  generate  a  time  sequence 
vector,  with  a  binary  mask  to  control 
the  variable  openings  representing  a 
matrix  format  to  perform  matrix- 
vector  multiplication  'nilarlED, 
with  higher  acc  ’rdcy  optical  architec¬ 
ture  for  matrix- vector  operation,  was 
a.vetoped  later  by  others.  They 
utilized  a  linear  array  of  LEDs  to 
generate  an  input  vector  and  array  of 
acousto-cp'ic  ce’J<  *o  represent  a 
matrix  formulation  of  vector-matrix 
multiplication.  To  avoid  the  interfac¬ 
ing  difficulties,  still  others  introduced 
a  systolic  array  processing  concept  for 
optical  matrix-matrix  multiplication. 

However,  the  analog  nature  of  the 
optical  processing  techniques  limits 

Light  Source 


the  accuracy  of  these  operations.  To 
alleviate  this  problem,  digital 
representation  was  introduced. 
Multiplying  two  numbers  on  a  digit- 
by-digit  basis,  a  numerical  multiplica¬ 
tion  technique  was  demonstrated  that 
could  perform  using  optical  convolu¬ 
tion  operations.  Next,  the  concept  of 
implementing  a  real-time  convolution- 
based  multiplication  was  introduced. 
The  idea  suggested  was  an  outer  pro¬ 
duct  technique  with  correlation 
matrices.  Also,  a  number  of  architec¬ 
tures  have  been  proposed  to  exploit 
the  parallelism  of  optics.  This  is 
described  in  a  survey  paper  by  R.  A. 
Athale.  (See  "Read  more  about  it.”) 

Matrix-matrix  multiplication 

To  exploit  the  parallelism  of  optical 
processing,  an  electro-optical  (EO) 
processor  is  used  as  shown  in  Fig.  1. 
This  EO  architecture  utilizes  an  outer 
product  technique  for  matrix-matrix 
multiplication. 

Figure  2  shows  the  outer  product 
computation.  When  the  row  and  col¬ 
umn  electrodes  of  a  two-dimensional 
(programmable)  electro-optic  spatial 
light  modulator  (SLM)  is  addressr J  ky 
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Fig.  2.  An  Outer  Product  Computation. 
two  binary  vectors  a  and  b,  such  as 

a  =  11  0  11,  and  1  =  (0  1  1], 

the  corresponding  outer  product 
would  be 


1  [0  !  n 

0  1  1 

0 

000 

1 

0  1  I 

It  is  clear  now  that  a  matrix-matrix 
multiplication  can  be  computed  by 
successive  outer  product  operations, 
as  shown  in  the  following  illustration. 


Symbolic  logic  processing 

Basic  optical  logic  array  processing 
has  been  reported  recently.  Thus,  a 
programmable  optical  symbolic  logic 
processor  can  be  constructed  as  shown 
in  Fig.  4.  A  collimated  light  is  used  to 
illuminate  three  cascaded  SLMs.  The 
product  of  their  generated  patterns  is 
then  imaged  onto  a  charge  coupled 
device  (CCD)  area  detector.  The  out¬ 
put  CCD  data  are  then  fed  to  elec¬ 
tronic  “OR"  circuits,  before  being 
stored  in  a  high  speed  memory 
subsystem. 

As  an  example,  a  binary  input  pat¬ 
tern  A  is  subdivided  into  N  x  N  small 
regions  called  “logic  cells.”  To  per¬ 
form  the  logic  operation,  the  value  an 
(0  or  1)  of  each  ijth  cell  are  encoded 
with  binary  patterns,  as  shown  in  the 
top  row  of  Fig.  5  (a).  We  then  utilize 
a  2  x  2  pixel  of  the  SLM  for  each 
logic  cell.  The  other  binary  input  pat¬ 
tern  B  is  encoded  in  a  similar  manner, 
as  shown  in  the  bottom  row  of  Fig. 
5(a).  These  encoded  binary  patterns 
can  be  generated  with  a  microcom¬ 
puter  memory  subsystem.  The 
encoded  patterns  of  A  and  B  are  then 
written  into  the  SLM1  and  SLM2, 
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50  35  53  25  1 
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6  - 
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01  11001110  00101001 
11  22002111  11111102 
01  11001110  00101001 
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00  00000000  00000000 
11  22002111  11111102 
00/1  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0 


Fig  3.  Matrix  Multiplication. 


.  transform  the  optical  signal  from 
l  >i  On  iij  cvcry  p^i  (after  the  light  passes 
through  the  cascaded  SLM)  into  ar¬ 
rays  of  electrical  signals.  The  four  pix- 
,e!  signals  of  a  logic  cell  can  be  com- 
Such  computations  can  also  be  used  respectively.  Since  SLM  1  and  SLM2  bined  with  a  Transistor  Transistor 

to  carry  out  the  multiplication  of  two  are  closely  cascaded,  the  combination  Logic  (TTL)  “OR”  gate.  Thus,  a 

arbitrary  matrices  by  appropriate  states  of  ajj  and  by  are  represented  by  l°R*c  operation  resulting  from  a  logic 

decomposition  and  summing.  the  patterns  shown  in  Fig.  5(b).  A  “U  03,1  ^  expressed  as 

Since  a  multiplication  between  two  logic  operation  in  one  channel  is  also 

single  bits  is  equivalent  to  the  logic  represented  by  a  2  x  2  pixel  pattern  cu  ~  +  &(aiJ>,j)  + 

operation  AND,  an  outer  product  of  the  SLM3.  (a, 0,y,6)  represents  the  7(fli iJ>ij)  +  ij>u), 

operation  can  be  carried  out  with  a  switching  states  (0  or  1)  of  the  pixels 

Magneto-Optic  (MO)  SLM.  In  other  of  a  logic  mask  as  shown  in  Fig.  5(c).  where  +  stands  logic  “OR” 

words,  the  rov.  and  column  electrodes  Thus,  the  combinations  of  these  2  x  operations. 

of  the  MOSLM  can  be  addressed  with  2  pixel  logic  cells  would  provide  a  total  The  spatial  representations  of  the 
two  binary  vectors  a  and  b,  and  the  of  16  logic  gates.  sixteen  logic  gates  and  the  resulting 

outer  product  C  can  be  directly  A  CCD  area  detector  is  used  to  patterns  are  shown  in  Fig.  6.  Since  the 
evaluated. 

With  reference  to  the  EO  architec¬ 
ture  of  Fig.  1,  the  grating  in  the 
Fourier  plane  diffracts  the  outer  pro¬ 
ducts  of  AB,  from  the  MOSLM,  to 
form  an  elementary  2x2  matrix  at 
the  origin  of  the  output  plane.  As  an 
example,  a  2  x  2  elementary  matrix 
C  =  AB  representation  of  a  16  x  16 
extended  binary  matrix  is  seen  in  the 
experimental  result  shown  in  Fig.  3. 

Thus,  a  higher  order  matrix 
multiplication  can  be  obtained  by  Memory 

decomposing  the  matrices  into  a  inieMoce 

number  of  elementary  2x2  matrices 

and  then  performing  the  basic  matrix  Fig.  4.  An  Electro-Optical  Symbolic 

multiplication  optically.  Logic  Processor  Microcomputer 
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where  =*  exp{  ~i2y mn  )  is  also 
N 

known  as  the  transform  kernel.  To 
implement  the  DFT  transformation 
in  an  electro-optical  processor,  we 
shall  present  the  complex  transform 
matrix  in  real  elements.  The  cor¬ 
responding  real  transform  matrices 
can  be  written  as 

R,  IVJ  =  cos  [ 


Fig.  S.  (a)  Encoded  Input  Patterns. 

(b)  Product  ot  the  Input  Patterns. 

(c)  A  Logic  Mask. 
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MOTE*  I  -  CONTACT.  PATTEMMt 
1-  INPUT  PAT  TEAMS 
S.  OUTPUT  PATTEMNS 

Fig.  6.  Representation  at  the  Sixteen  Logic  Functions 


final  result  of  cn  is  represented  by  an 
electrical  signal,  it  can  be  directly 
stored  in  the  memory  subsystem, 
which  can  be  used  in  the  next  cycle  of 
operation. 

It  should  be  noted  that  the  com¬ 
binations  of  the  16  logic  functions  are 
the  fundamentals  of  the  arithmetic 
operations  of  a  digital  computer.  It  is 
obvious  that  the  proposed  technique 
has  the  ability  to  perform  the 
arithmetic  operation  of  two  input 
patterns. 


Discrete  linear  transformations 

A  discrete  linear  transformation 
(DLT)  system  represented  in  Fig.  7 
can  be  characterized  by  an  impulse 
response  hmn.  The  input-output  rela¬ 
tionship  of  such  a  system  can  be  sum¬ 
marized  by  the  following  equation: 


Since  the  output  gm  and  input  /„ 
can  be  considered  as  vectors,  the 
above  equation  can  be  represented  in 
matrix  form,  that  is 


1  g> 

g> 

*! 

= 

gm- 1 

frfam.n, 

1 


l,2...,m. 


Fig.  7.  Discrete  Unear  Transform. 


|  gm- 1  J  |Am-I.O 

or  abbreviated  as, 

( gm]  ~  lhm,JlfrJ> 

where  lhm  n]  is  known  as  a 
transform  matrix.  Thus,  the  different 
DLTs  would  have  different 
transform  matrices.  We  shall  now 
illustrate  a  few  frequently  used 
DLTs. 

Discrete  Fourier  transform  (DFT) 

The  DFT  is  defined  by 

1  "-1 

fa—  E  f„  expl-^7  mn\ 

r"  N  n  =  (T"  H  N  ’ 

0  s  m  s  n  -  1, 


Im[hm  J  =  sin  [  2™"l. 


which  are  the  well-known  discrete 
cosine  transform  (DCT)  and  discrete 
sine  transformation  (DST). 

Discrete  Hilbert  transform  (DHT) 

It  is  well-known  that  the  relation¬ 
ship  between  the  real  and  imaginary 
parts  of  an  analytic  signal  can  be 
described  by  the  Hilbert  transforma¬ 
tion.  The  elements  of  a  discrete 
Hilbert  transform  (DHT)  matrix  can 
be  written  as 


2  x  sin*|T(m-n)/2) 
hm,n  =  "jr  (m-n) 

0,  m  -  n  ,  0  , 

m  -  n  =  0  . 

Discrete  Chirp-Z  Transform 
(DCZT) 

Another  frequently  used  linear 


transformation  is  the  Chirp-Z 
transform,  which  can  be  used  to  com¬ 
pute  the  DFT  coefficients.  The 
elements  of  the  DCZT  transform 
matrix  can  be  written  as 

hm.n  =  exp(iT(m  -  n)’/N] 

We  note  that  this  type  of  shift- 
invariant  transformation,  as  well  as 
other  types  of  DLTs,  can  be  im¬ 
plemented  by  an  electro-optical  pro¬ 
cessor  with  a  systolic  array  process¬ 
ing  technique. 

Since  the  discrete  linear  transfor¬ 
mation  can  be  viewed  as  the  result  of 
a  matrix-vector  multiplication,  the 
systolic  array  processing  architecture 
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can  be  used  for  the  implementation 
of  a  DLT.  Thus,  by  combining  the 
systolic  array  processing  technique 
and  the  two’s  complement  represen¬ 
tation,  a  DLT  can  be  performed  with 
an  electro-optical  processor  as  shown 
in  Fig.  8.  This  technique  has  a  high 
accuracy  and  low  error  rate  process¬ 
ing  capability.  And  it  is  compatible 
with  other  digital  processors. 

An  example  of  a  DLT  using  the 
systolic  array  processing  technique  is 
illustrated  in  Fig.  9.  In  Fig.  9(a),  a 
three-sample  points  discrete  cosine 
transform  (DCT)  matrix  is  encoded 
in  the  two’s  complement  form,  and 
multiplied  with  an  input  vector  using 
the  systolic  array  method.  A  discrete 
sine  transformation  (DST),  carried 
out  by  the  systolic  array  method,  is 
shown  in  Fig.  9(b).  Thus,  by  combin¬ 
ing  DCT  and  DST  of  Figs.  9(a)  and 
9(b),  a  discrete  Fourier  transform  can 
be  obtained. 

Concluding  remarks 

Since  MOSLM  can  be  addressed  in 
patial  parallel  mode,  the  whole  frame 
pattern  on  MOSLM  can  be  switched 
in  a  very  rapid  manner:  for  example, 
6.4  /ts  for  a  64  x  64  MOSLM;  51.2 
pis  for  a  512  x  512  MOSLM.  By 
utilizing  a  high  speed  memory  sub¬ 
system  with  a  specially  designed  inter¬ 
facing  circuit,  (the  technology  is 
available)  a  relatively  slow  microcom¬ 
puter  can  be  used  to  manipulate  the 
parallel  operation  of  the  MOSLMs. 
This  is  known  as  a  single  instruction 
multiple  data  (SIMD)  operation.  In 
addition,  with  the  introduction  of  a 
microcomputer  into  the  system,  a 
man-machine  communication  link  is 
also  provided.  To  generate  the  systolic 
array  formats  rapidly,  a  table  look  up 
structure  is  suggested.  After  the  time 


integrating  CCD  detector,  a  high 
speed  analog  to  digital  converter 
(ADC)  and  a  serial-parallel  defor- 
mater  would  be  used.  Thus,  by  ex¬ 
ploiting  the  programmability  of  the 
computer,  various  linear  algebraic 
operations  can  be  performed  with  this 
hybrid  optical  architecture. 

Finally,  by  exploiting  the  efficient 
operation  of  optics  and  the  program¬ 
mability  of  electronic  computer,  it  is 
the  author’s  belief  that  hybrid  optical 
architecture  would  be  the  logical  ap¬ 
proach  toward  modern  optical  com¬ 
puting.  However,  much  remains  to  be 
done  in  the  development  of  electro- 
optical  devices  before  the  hybrid  op¬ 
tical  computing  can  become  a 
widespread  practical  reality.  We  hope 
this  article  will  stimulate  interested 
readers  to  produce  more  imaginative 
hybrid  optical  computing  applications 
in  the  future. 
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Acronym  Conversion  Table 

ADC  —  analog  to  digital  converter 

CCD  —  charge  coupled  device 

DCT  —  discrete  cosine  transformation 

DCZT  —  discrete  chirp  •  z  transformation 

DFT  —  discrete  Fourier  transformation 

DHT  —  discrete  Hilbert  transformation 

DLT  —  discrete  linear  transformation 

DST  —  discrete  sine  transformation 

EO  —  electro-optical 

LED  —  light  emitting  diode 

MO  —  magneto-optic 

MOSLM  —  magneto-optic  spatial  light 
modulator 

SIMD  —  single  Instruction  multiple  data 
SLM  —  spatial  light  modulator 
TTL  —  transistor-transistor  logic 
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This  paper  describes  the  methods  of  implementing  an  optical  half-adder  and  a  full  adder  utilizing  programmable  liquid  crystal 
televisions  (LCTV).  The  concept  of  constructing  an  optical  full  adder  is  based  upon  the  realization  of  an  optical  read-only- 
memory  (OROM).  An  experimental  demonstration  of  binary  number  addition  performed  by  an  optical  half-adder  is  given. 


1.  Introduction 

Prior  to  our  discussion,  we  note  that  the  optical 
binary  adder,  when  used  in  digital  optical  comput¬ 
ing,  is  a  basic  part  of  the  central  processing  unit 
(CPU).  Methods  of  making  an  optical  half-adder  and 
full  adder  have  been  proposed  by  several  investiga¬ 
tors  in  the  past  few  years  [1,2].  Having  already  built 
a  4-bit  half  adder,  Lohmann  and  Weigelt  have  pro¬ 
posed  a  1-bit  full  adder  that  is  based  on  the  spatial 
filtering  technique  ( 1  ].  In  order  to  implement  a  1- 
bit  half-adder,  Khan  and  Nejib  [2]  have  proposed 
an  optical  structure  that  employs  crystal  switches.  In 
addition  to  these,  we  have  recently  proposed  a 
method  that  performs  XOR  logical  operations  uti¬ 
lizing  liquid  crystal  televisions  (LCTV)  [3],  The 
XOR  logical  operation  is  in  fact  a  key  operation  in 
a  binary  adder. 

The  basic  difference  between  a  half-adder  and  a 
full  adder  is  the  carry-transmission.  A  1-bit  half-ad¬ 
der,  however,  docs  not  require  carry  input.  If  tv  i  bits, 
A,  and  B„  are  added  together,  the  half-adder  would 
produce  a  sum  S„  and  a  carry  C,*,.  i.e.,  S,  =  A,®B„ 
C,*  |  =A,  B,.  In  a  l-bit  full  adder,  three  inputs,  C„  A„ 
and  B„  would  also  produce  a  sum  and  a  carry,  i.e., 
S,  =  A,©B,®C,  and  C,+  i  =  (A,®B|)'C,  +  A,'B,.  In  a 
n-bit  full  adder  (n>  I ),  the  carry  is  transfered  bit  by 
bit  from  the  least  significant  bit  (LSB)  to  the  most 
significant  bit  (MSB).  We  stress  that  the  main  dif¬ 
ficulty  in  building  an  n-bit  optical  full  adder  lies 
within  the  realization  of  carry-transmission.  To 


overcome  this  problem,  the  optical  read-only-mem¬ 
ory  (OROM)  is  introduced. 

In  this  paper,  we  propose  a  multi-channel  optical 
half-adder  using  LCTVs.  This  optical  half-adder  is 
capable  of  performing  the  XOR,  AND,  NOT,  and 
OR  logical  operations.  An  experimental  demonstra¬ 
tion  of  the  proposed  half-adder  is  provided.  Finally, 
by  introducing  an  OROM  to  the  system,  we  can  re¬ 
alize  a  2-bit  optical  full  adder. 


2.  An  optical  half-adder 

The  logical  operations  of  a  half-adder  produce  a 
sum  S,  and  a  carry  C,+  I  such  as 

S,  =A,®8,  ,  (1) 

C,+ ,  =A,  B,  ,  (2) 

where  A,  and  B,  are  the  input  bits.  Since  XOR  and 
AND  operations  are  required  in  a  half-adder,  they 
can  easily  be  implemented  w(jh  LCTVs  as  shown  in 
fig.  I.  In  the  optical  system,  two  microcomputers  are 
used  in  order  to  produce  the  image  patterns  for  A 
and  B  onto  two  LCTVs.  Two  LCTVs  perform  the 
XOR  operations  with  the  polarization  logic  in  which 
the  logical  “0’s"  are  encoded  in  horizontal  polari¬ 
zation  while  the  logical  "I’s”  are  encoded  in  vertical 
polarization.  To  perform  the  XOR  and  AND  oper¬ 
ations  in  parallel,  it  is  required  that  pattern  B  is  writ¬ 
ten  twice  (e.g.,  B2  is  the  extra  copy  of  B  in  fig.  I ) 
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Fig.  I.  An  optical  setup  for  4-bit  parallel  half-adder:  A,  B,  inputs:  Ml.  M2,  mirrors;  PI.  P2.  P3.  polarirers. 


The  sum,  S,  produced  by  the  LCTVs  is  directly  de¬ 
tected  by  an  analyzer.  The  intensities  of  patterns  A 
and  B  can  be  combined  together  to  perform  the  log¬ 
ical  operation  OR,  which  is  basically  performed  in 
the  intensity  logic.  We  note  that  a  polarizer  set  in  the 
contrast  reverse  mode  can  be  used  as  a  NOT  gate. 
Therefore,  an  AND  gate  can  be  implemented  with 
the  optical  structure  shown  in  fig.  2.  In  this  structure, 
the  DeMorgan’s  Theorem  is  applied,  such  as, 


XY=£©?.  (3) 

In  the  experimental  demonstrations,  we  used  four- 
channel  half  addition  in  parallel.  We  have  chosen  ihe 
following  values  to  reflect  the  general  case. 

A|  =0  ,  A2  =  l,  A,  =  I  ,  A,=0;  (4) 

B,  =0  ,  B2  =  l  ,  B,  =0  ,  B4  =  l.  (5) 


Fig  2.  An  "AND"  logical  gate  using  three  polarizers:  X.  Y,  inputs;  Z.  output:  PI,  P2.  P 3.  polarizers 
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Fif.  3.  An  experimental  demonstration  of  an  optical  half-adder  A.  B.  inputs;  S.  sum;  C.  carry 


Consequently  the  output  data  would  be, 

S,=0.  S2=0,  S,  =  l.  Sa  =  l;  (6) 

C,=0,  Cj  =  1  ,  C,=0,  C<  =0 .  (7) 


The  results  obtained,  which  include  two  input  pat¬ 
terns  and  two  output  patterns,  are  shown  in  fig.  3. 
Note  that  the  distance  between  two  LCTV$  should 
satisfy  the  following  inequality  condition  [3|: 


Fit.  4.  A  block  diagram  of  an  n-bil  full  adder 
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:<d'h l,  (8) 

where  z  is  the  distance  between  two  LCTVs,  d  is  the 
width  of  a  square  resolution  cell,  and  A  is  the  wave¬ 
length  of  the  light  source.  In  our  experiment,  a  He- 
Ne  laser  oscillating  at  A  =  632.8  nm  is  used.  Since  the 
resolution  of  LCTV  d=  370  pm,  we  set  the  distance 
between  the  LCTVs  to  about  20  cm  (see  fig.  I ). 

Although  15x20  pixels  were  used  to  represent  I- 
bit  data  in  our  experiment,  fewer  pixels,  as  small  as 
one  pixel  in  I -bit,  can  be  used  in  this  experiment.  To 
reduce  the  coherent  artifact,  a  white  light  source  can 
be  used  in  the  system  [4J. 

3.  An  optical  full  adder 

To  add  the  new  carry-in  to  the  inputs  of  A  and  B 
at  the  LSB,  the  n-bit  full-adder  should  have  the  ca¬ 
pabilities  of  performing  the  carry-transmission  (be¬ 
tween  the  successive  bits  from  LSB  to  MSB)  and  of 
detecting  the  overflow  errors.  For  an  n-bit  full  adder, 
S,  and  C,  can  be  obtained  by  the  recurrent  equations. 

SS,  =  A,®B,©CC,  ,  (9) 

CC,+  i  =  (A,®B,)  CC, +A,  B,  ,  (10) 

where  SS,  represents  the  ith  sum  bit  and  CC,  denotes 
the  ith  cairy  output  bit  of  a  full  adder. 


The  simplest  means  of  implementing  a  full  adder 
is  to  feed  the  carries  bit  by  bit.  This,  however,  is  not 
an  easy  task  to  perform  when  using  an  optical  pro¬ 
cessor.  Nevertheless,  with  the  addition  of  an  OROM, 
an  optical  processor  can  perform  the  carry  trans¬ 
mission,  as  proposed  in  fig.  4  and  fig.  5.  In  other 
words,  the  OROM  can  allow  a  full  adder  to  perform 
addition  in  parallel  without  feeding  carries.  We  fur¬ 
ther  note  that  an  OROM  is  a  digital  logic  device  that 
can  be  implemented  with  any  binary  logical  function. 

In  a  2-bit  full  adder,  the  sum  SS  and  the  Coul  can 
be  produced  by  S,  and  C,  that  have  been  obtained 
from  the  output  of  the  improved  half-adder.  Let  us 
now  state  the  following  relations: 


SS,  =A,  ®B,  ®C,„  =S,  . 

(11) 

CC2  =  S,  C,„  +A,  B,  =S,  C,„  +C2  . 

(12) 

SS2=S2©CC2=S2  CC2+S2  CC2  , 

(13) 

Cou,  =§i  S2  C,„  +C2  S2  +c, , 

(14) 

where  A,  and  B,  are  the  input  patterns,  C„,  is  the  carry 
input,  S,  and  C,  are  the  ith  output  sum  and  carry  ob¬ 
tained  from  the  improved  half-adder,  and  C„„,  is  the 
carry  output  of  the  full  adder.  We  stress  again  that 
the  relations  (II )— ( 14)  can  be  implemented  with  an 
optical  processor  using  an  OROM,  as  shown  in  fig. 
6.  The  logic  diagram  for  this  setup  is  illustrated  in 
fig.  7. 


MSB  LSB 

1*  1 1  l'I'J  CARRY  IN  -  0  (IN  SAME  POLARIZATION  AS  SOURCE  LI QIT) 


lilt  I ’.I")  CARRY  IN  -  1  (IN  VERTICAL  POL\RIZATION  WITH  SOURCE  LIGHT) 


ILLUMINATIVE  LIGHT 
WITH  CARRY  INPUT 


LICHT  SOURCE 
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Fig.  6.  Optical  Implementation  of  an  OROM  for  sum  bit  and  carry  out.  (a)  Sum  bit  SS,  (b)  Carry  out  C„,,. 


Overflow  errors  occur  whenever  the  addition  of 
two  numbers  results  in  a  sum  which  is  too  large  or 
too  smalt  to  be  represented  by  n  bits.  Consequently, 
the  detection  of  overflow  errors  is  required  for  a  full 
adder.  This  is  done  by  utilizing  the  well-known  rules, 
for  an  unsigned  number, 

E  =  Caul  ,  (15) 

and  for  a  signed  number, 

E=C„©C„+I  ,  (16) 

where  E  =  0  and  E  =  I  indicate  overflow  error  and  no 
overflow  error  respectively. 

Thus,  in  a  2-bit  full  adder,  we  would  have, 

E  =  CC2®CMll=CCj  C^i  +  CCl  C^,  .  (17) 


Fig.  7.  A  logic  diagram  of  an  OROM  for  sum  bit  and  carry  out 
(a)  Sum  bit  SS:.  (b)  Carryout  C„... 
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experimental  demonstration  shows  that  a  4 
addition  can  be  obtained.  This  result  shows 
era!  case  for  an  optical  half-adder.  The  opt 
adder  can  be  easily  extended  to  perform  l 
rays-number  addition,  by  simply  changing 
puter  program  of  the  microcomputer.  We  i 
no  extra  coding  procedure  is  required  in  th( 
der,  since  the  number  was  automatically  en 
the  LCTV.  To  extend  a  half-adder  to  perfo 
adder  operation,  we  introduce  an  OROM 
transmission  and  overflow  error  detection 
tical  architecture  of  a  2-bit  full  adder  using  ai 
is  also  proposed  in  this  paper. 
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Fig.  8.  An  overflow  delector  system.  < a >  Logical  diagram,  (b) 
Optical  implementation. 

This  logical  operation  may  be  performed  by  an  op¬ 
tical  processor  using  an  OROM,  as  proposed  in  fig. 
8. 

4.  Conclusion 

We  have  demonstrated  a  method  of  building  an 
optical  half-adder  using  a  programmable  LCTV.  An 
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I.  INTRODUCTION 

Symbolic  substitution  was  originally  proposed  b-  iluaug1  as 
a  means  til  utilizing  I  lie  parallelism  of  npti'  -  .rlorni  digital 
computing  Some  possible  implementation-  ol  synthttlie  sub¬ 
stitution  have  been  demonstrated  b-  'Jr  ■  eretal.,11  Isaocl 
al..4  and  Casascnl  and  Botha.5  Rece  ..ty,  wc  proposed  two 
methods  lor  the  optical  implementation  of  symbolic  substitu¬ 
tion*  bused  on  (l)a  two-step  Vander  Lug!  filter,  which  was 
also  pointed  out  by  Casa.nt  and  Botha’  and  was  applied  by 
Pack  and  I’saltis.’  and  (2)  one-step  holographic  associative 
memories. ’  •  In  this  paper,  we  demonstrate  the  experimental 
vcrilication  of  syntoolic  substitution  using  one-step  holo¬ 
graphic  associative  memories. 

1.  BACKGROUND 

Unlike  Boolean  logic,  symbolic  substitution  recognizes  not 
only  a  combination  of  bits  hut  also  their  relative  locations.1 
I  he  output  is  not  just  a  single  bit  but  rather  a  combination  of 
bits  positioned  in  a  particular  manner.  Figure  1(a)  is  a  sche¬ 
matic  diugtaui  ol  symbolic  substitution  logic.  Symbolic  sub¬ 
stitution  is  essentially  a  combination  of  recognition  and 
v  bsliltition  phases.  I  herefore,  optical  associative  memories 
may  he  applied  to  construct  u  symbolic  substitution  logic 
system.  In  this  system  logical  I  and  logical  0  aie  encoded  in 
cettain  spatial  patterns,  l  or  example,  the  logic  patterns 


Imileil  Paper  SI*- till  received  Nov  14  1987;  revived  nis nnvcripl  received 
Dec  211,  19X7;  accented  lor  publication  Dec  20.  19X7:  received  b)  Managing 
I  dir  or  tan  21 . t9XX  Portion*  ol  this  paper  were  prevented  av  paper  883  - '  5  at 
tlx-  SPIE  conference  Holographic  Optic*;  Design  and  Applications.  Jan 
13  14.  I9KX  I  ov  Angeles.  Calil  I  he  paper  presented  there  appear*  Itinrel- 
erectll  in  SPII:  Proceeding*  Vnl.  NH1 

4r  PJXX  Soviet)  of  Photo-Optical  Instrumentation  Engineer* 


shown  in  Fig.  1(a)  may  be  encoded  into  the  patterns  shown  in 
Fig  1(b).  1  his  has  the  advantage  of  distinguishing  logical  0 
and  a  void  space  having  no  information. 

The  basic  experimental  setup  is  depicted  in  l  ig.  2.  A  joint 
Fourier  transform  hologram  of  an  input  and  an  output 
pattern  is  first  recorded  as  shown  in  f  ig  2(a)  I  he  output 
pattern  is  then  generated  optically  by  illuminating  the  holo¬ 
gram  with  the  input  pattern  in  the  optical  setup  shown  in  f  ig. 
2(b).  To  perform  a  Boolean  operation,  the  AND  function,  lor 
instance,  four  associative  memories  are  required,  correspond¬ 
ing  to  four  possible  combinations  ol  two  inputs.  I  his  tech¬ 
nique  differs  from  the  truth-table  look-up  optical  processor,'1  in 
which  hasically  applies  the  intcrfcromcti ic  subtraction 
technique. 

3.  NONLINEARITY  REQUIREMENT 

Botha,  Casa  sent,  and  Barnard  "  pointed  out  that  a  contradic¬ 
tion  would  be  present  if  a  linear  hologiaphic  filter  were  used  to 
perform  nonlinear  logic  operations  I  o  show  this,  we  consider 
the  symbolic  substitution  for  the  AND  function.  With  the 
four  possible  inputs  denoted  as  ll)0(x,y),  l„,(x.y).  Imfx.y), 
and  lM(x,y).  the  four  AND  outputs  are 

Ow(x.y)  =  O0,(*.y)  -  O,0(x.y)  =  zerofx.y)  . 

ID 

0,,(x.y)  =  one(x.y)  . 

where  zerol  x  .  y)  and  onc(  x  ,  y)  ate  the  patterns  representing 
binary  numbers  0  and  I ,  respectively  I  he  input  spatial  func¬ 
tions  are  composed  of  the  following' 

l„,(x.y)  =  rerofx-a, . y — b, 3  +  zero(x-a,.y-b,|  . 

!„,(*■  yl  =  zerotx-a^y-b,)  I-  or*e(x-»,.y- h,|  . 

(21 

l,0fx.y)  =  nncfx— a, ,y— b,(  +  /ero(x-a,.y-b,)  . 

I|,fx.y)  =  onefx-a, . y — b, )  I-  one(x-a,.y- b,|  . 

where  (a, ,  b, )  and  (a? ,  b;)  are  the  positions  ol  the  lirst  and 
second  input  bits.  Considering  the  holographic  filleting  as  a 
linear  system,  it  is  seen  that 

l„<x.y>  =  l„,lx.y)  +  l,„(x.y)  -  !,»,< x . >  1  .  (R 
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Fig.  1 .  (a)  Schematic  diagram  of  symbolic  substitution  logic.  (b|  Log- 
lesl  1  and  logical  0  ancodad  into  cartain  spatial  paltarns. 


Fin  L,  H 


|b| 

Fig.  2.  Is)  Racordlng  of  |olnt  Fouriar  transform  hologrsm  of  sn  Input 
and  an  output  pattarn.  (bl  Raconstruclion  of  output  from  an  asso- 
ciatad  Input  pattarn.  Input  pattarn  Is  also  obsarvad  In  tha  output 
plana  dua  to  tha  do  farm  of  tha  hologram. 

and  (he  corresponding  output  must  be 

0,l(x.y)  +  0„(x,y)-0w(x.y)  =  rero(x.y)  .  (4) 

which  is  contradictory  to  the  logic  output 

0„(x,y)  =  one(x.y)  .  (5) 

To  overcome  this  problem,  the  system  as  a  whole  must  be 
nonlinear.  We  conducted  the  experiment  in  the  same  spirit  as 
those  of  Refs.  5.  7,  and  1 1  and  the  first  method  described  in 
our  previous  letter,'  that  is,  as  a  process  of  independent  multi¬ 
channel  correlations. 

4.  EXPERIMENT 

We  used  photographic  film  as  the  input  transparency.  Nine 
pixels  were  required  to  encode  one  bit.  as  depicted  in  Fig  Mb). 
The  patterns  representing  I  and  0  cannot  be  orthogonal  since 
the  orthogonality  will  eliminate  the  association  of  two  pat¬ 
terns.  In  other  words,  the  two  patterns  must  have  overlapping 
spectra  in  the  Fourier  plane  in  order  to  yield  a  good  holo¬ 
graphic  image. 


Fig.  3.  Combination*  of  Input*  and  tha  lasulting  sum  and  carry 


t 

tbl 

Fig  4.  fa)  Input  pattern  superimposed  with  n  cross  nonchi  grating  in 
tha  spatial  modulation  tnchniqun.  (bl  Mologrnin  indicntoi  that  multi¬ 
ple  spectra  occupy  the  lour  quadrants  of  tha  Fourier  plana. 

We  implemented  n  hall -ntltlci .  in  «  hit'll  sum  ( XI  )R  I  unc¬ 
tion)  and  carry  (AND  function)  me  pciloimcd  simulta¬ 
neously  from  the  same  data  I  his  is  an  example  ot  ihc 
realiralion  of  multiplc-instmctiim  multiple  data  (MIMI)) 
architecture  utilising  the  parallelism  <d  optics  I  out  combina¬ 
tions  of  input  and  Ihc  corresponding  oulpot  condonations  of 
sum  and  carry  arc  illustialcd  in  I  ip  t  In  implement  four 
associatixc  memories  io  a  single  ludopiam.  we  applied  the 
spatial  modulation  technique.'-’  in  which  an  additional  ctoss 
Ronchi  grating  was  superimposed  wiili  the  input  pattern  to 
gixe  multiple  carrier  licqucncics.  as  shown  schematically  in 
Fig.  4(a) 
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Fig.  5.  Experimental  results  showing  direct  associations,  obtained  using  only  one  uncovarad  quadrant  of 


the  hologram  for  each  association. 


X 

X 


Fig.  6.  Experimental  result  of  1  -FI  half-addition. 


X*4>X 

A  t  ■ 


Fig.  7.  Experimental  result  showing  the  association  between  four 
Inputs  with  a  filter  of  010  Only  one  rlnminont  output  pattern  was 
obsarvad.  as  was  expected  Icniry  =  0.  sum  ~  0). 


In  I  he  synllicsis  of  the  holographic  filler1!,  a  mask  was 
employed  in  I  he  Courier  plane  such  dial  each  input  combina¬ 
tion  occupied  only  one  quadrant  of  Ihe  I  mirier  plane,  as 
depicted  in  Fig  4(h)  litis  multiple-spectrum  configuration 
enhances  the  dynamic  range  of  the  holographic  filter.1’  It  is 
important  to  note  that  this  multiple-spectrum  configuration 
may  also  approach  nnnliucaiily  since  it  is  very  common  to 
obtain  slightly  dillcrcnl  baudwidths  lor  different  associative 
memories.  In  the  linal  stage,  a  video  monitor  system  was 
applied  in  ihc  system  to  delect  and  threshold  Ihe  hologtam- 
gcnctalcd  output. 

A  set  ol  experimental  results  is  shown  in  Hg.  5.  these 
direct  associations  were  obtained  using  only  one  uncovered 
quadrant  ol  Ihe  hologram  lor  each  association,  lo  pcrlorm 
parallel  half-addilinu.  the  entire  hologram  was  uncovered.  An 
example  of  parallel  hull-addition,  i.e  ,  sum  and  carry  obtained 
in  parallel,  is  shown  in  big  6  lloth  l  igs  5  and  ft  were  taken 
Iroin  Ihe  video  monitor  alter  thresholding.  Although  cross- 
correlation  still  exists,  the  dominant  output  is  the  currccl  logic 


pattern  I  bus,  it  is  seen  fiom  the  exper intents  that  the  whole 
system  is  nonlinear  I  or  compatison.  I  ig  7  shows  the  output 
when  lour  input  combinations  arc  associated  with  only  one 
memory  (onlv  one  quadiant  ol  the  hologiam)  I  lie  input 
associated  with  the  filler  produced  Ihc  dominant  output 
pattern. 

S.  DISCUSSION 

1  he  absence  ol  Ihc  contradiction  ol  linearity  can  be  explained 
in  Ihc  following  discussion  I  or  1  he  case  in  w  Itich  (he  input  is 
l,,(x.y).  a  quarter  ol  the  input  energy  (assume  'it  )  will  be 
incident  on  the  quadiant  associated  with  lM  ( x  .  y)  I  he  output 
O,,  I  x  ,  y)  will  have  a  total  intensity  ol  1 .  o  l:..  that  is 


where  o  is  the  energy  dillraction  efficiency  of  the  hologram 
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A  quarter  of  the  input  energy  (>/t  E)  also  will  be  incident  on 
the  quadrant  associated  with  l0,(x.y).  Since  l,,(x.y)  = 
.y)  l|o(*  >y)  —  •  y)  l Eq.  (3 ) J,  the  output  from  this 

quadrant  is  O0|(x,y)  plus  the  noise  N(x,y)  coming  from  the 
crosstalk  between  l,0(x.y)and  lnl(x,y)and  between  lw(x,y) 
and  l0l(x.y).  Therefore,  the  output  patternO0,(x.y)  will  have 
a  total  intensity  lower  than  Vt  a  E.  It  is  seen  that 

IO»i(*.y)  +  N(x,y)|'dxdy  =  ■«£  ,  <7J 

Thus 
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The  other  two  quadrants  follow  the  same  analysis.  We  may 
conclude  that  the  output  pattern  O0,(x.y)  +  O,0(x.y)  - 
Ono(x.y)  =  zero(x.y)  [Eq.  (4)]  generated  from  three  quad¬ 
rants  always  has  lower  intensity  than  that  of  the  output  pat¬ 
tern  Ou(x ,  y)  =  one(x .  y) (.Eq.  (5)J  directly  generated  from  the 
quadrant  associated  with  l„(x.y).  Thus,  a  thresholding  pro¬ 
cess  can  be  applied  to  harddip  the  total  output  pattern  and 
result  in  a  clean  pattern  0,,(x,y). 

«.  CONCLUSION 

We  have  demonstrated  an  experimental  procedure  to  imple¬ 
ment  symbolic  substitution  logic  using  one-step  holographic 
associative  memories.  In  the  experiment,  a  spatial  modulation 
technique  was  applied.  1  he  spatial  modulation  technique 
gives  more  flexibility  in  the  filter  synthesis  than  the  multiplex¬ 
ing  technique  since  the  hologram  has  a  limited  dynamic  range. 
Il  is  seen  that  the  constructed  system  is  nonlinear.  A  very 
simple  example  of  MIMD  operation,  i.e.,  parallel  half-addi¬ 
tion,  has  been  shown.  Utilizing  real-time  spatial  light  modula¬ 
tors  such  as  LCLV,  LCTV,  MOSLM.etc.,  a  full  addition  may 
be  realized  by  multislep  substitution.1  If  the  final  cross-corre¬ 
lation  can  be  totally  eliminated,  the  proposed  one-step  holo¬ 
graphic  technique  may  be  superior  to  the  pinhole  sampling 
technique,'  since  the  one-step  technique  is  fully  space 
invariant. 
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Abstract.  An  architecture  lor  a  real-time  signal  correlation  based  on  optical 
joint  transform  correlation  is  proposed  Two  parallel  on-plane  acousto-optic 
(AO)  cells  and  square-law  converter  are  employed  to  produce  cross  correlation 
of  two  electrical  signals.  Arrangement  of  the  two  AO  cells  on  the  same  plane 
permits  this  architecture  to  be  implemented  in  a  compact  form  The  proposed 
architecture  has  a  capability  of  performing  parallel  multiple  cross  correlations 
by  addition  of  AO  cells  on  the  input  plane  The  theoretical  analysis  and  prelimi¬ 
nary  experimental  results  are  presented. 

Sub/ect  terms:  signal  processing:  acousto-optic  signal  processing.  joint  transform  corre¬ 
lation.  digital  communication. 

Optical  Engineering  27171.  507-S1 1  (July  19881 


CONTENTS 

I  Introduction 

2.  1  Iteory 

3.  1  hree-cell  system 

4.  Experimental  demonstrations 

5.  Conclusion 

6.  Acknowledgments 

7.  References 

I.  INTRODUCTION 

Acousto-optic  (AO)  signal  correlators  have  been  of  particular 
interest  in  such  applications  as  matched  filters,  ambiguity 
function  processors,  and  spectrum  analyzers,*'4  in  which  real¬ 
time  processing  is  indispensable  A  variety  of  architectures  for 
signal  correlators  have  been  developed.  These  architectures 
can  be  categorized  into  two  basic  types:  multiplicative  and 
additive  5  In  the  multiplicative  type,  the  laser  beam  is  sequen¬ 
tially  modulated  by  two  successive  AO  cells  and  detected  by  a 
photodetector  array.  In  the  additive  type,  the  laser  beam  is 
split  into  two  paths,  each  of  which  is  singly  modulated  by  an 
AO  cell  and  combined  on  a  photodctcctor  array  where 
square-law  mixing  takes  place. 

This  paper  proposes  an  architecture  for  a  real-time  space 
integrating  correlator  based  on  the  optical  joint  transform 
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correlator.  Two  parallel  on-planc  AO  cells  arc  employed  (o 
convert  electrical  signals  into  acoustic  strain  fields  A  trans¬ 
form  lens  produces  the  joint  transform  of  the  optical  pattern 
induced  by  the  acoustic  strain  fields.  A  square-law  converter, 
e.g  ,  a  liquid  crystal  light  valve  (I.CLV).  can  ex  I  tact  the  joint 
transform  power  spectrum  1  he  inverse  Fourier  transform  of 
the  coherent  readout  of  the  square-law  converter  provides  the 
cross  correlation  of  input  signals.*  " 

Since  two  AO  cells  are  on  the  same  plane,  the  proposed 
architecture  can  be  implemented  in  a  compact  system  Hy  the 
addition  of  an  adequate  number  of  AO  cells  on  the  input 
plane,  this  architecture  can  be  easily  extended  to  a  system  that 
yields  more  than  two  cross  correlations  I  his  leature  is  impor¬ 
tant  for  digital  communication  in  which  different  waveforms 
are  used  to  represent  different  messages. 

2.  THEORY 

Optical  setup  of  the  proposed  correlator  is  shown  in  Fig  I 
Figure  2  depicts  the  geometry  of  the  input  plane  I  wo  AO  cells 
(AO,  and  AO?)  with  dimensions  a  and  b  arc  inserted  in  the  input 
plane  with  centers  at  (a/ 2,  It/ 2)  and  (a/ 2,  -h/  2)  Moth  AO  cells 
are  operating  in  Bragg  regime.  Narrowband  input  signals  s,(t) 
and  s,(l)  induce  acoustic  strain  fields  in  AO  cells  We  assume 
that  the  complex  wave  amplitude  transmittance  functions  of 
AO,  and  AOj  are  g,(x  ,  y  ~  h  /  2. 1)  am.  g2(x  ,  y  +  h  /  2 . 1),  respec¬ 
tively,  where  x  and  y  are  the  spatial  coordinates  along  and 
perpendicular  to  the  axis  of  acoustic  wave  propagation,  h  is  a 
separation  between  two  AO  cells,  and  t  denotes  time. 
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Fig.  1 .  Optical  aatup  lor  an  acousto-optic  signal  correlator.  AO .  and 
AO,— calls:  l,  and  L,— transform  lenses:  Lj  and  L4— magnifying 
lanaea;  S— square-law  converter;  BS— beam  spllttar. 


Fig.  2.  Oaomatry  of  a  two-cell  syatem. 


I  a  king  l  lie  input  end  ol  AC)  cells  its  l  lie  origin  til  I  lie  x  axis. 
g'(x.y.t)  and  g,  ( x  .  y .  I )  can  be  w  i  it  ten  as 


f,(x.y.t)  =  exp 

ir'r  ( 
' 

■-fi 

]  "  (  X  .  V  )  . 

(7) 

g.tx.y.if  =  exp 

■-7) 

j  »  (  X  .  V  I  . 

|K> 

where 


»(x.y) 


b  b 

I  0  <  x  <  3.  -  y  <  t  <  - 

0  otherwise  . 


lH 


y  is  the  mod  u  la  lion  deplli.  ami  v  is  sound  velocity  in  At)  cells. 
For  small  -y.  Ft|s.  (7)  and  (8)  can  be  approximated  by  (lie 
following  equations’  *: 


g,(x.y.i)  = 

1  +  jys,( 

-t) 

j  "  I  X  ■  >  )  - 

(Mil 

g,(x.y.i)  = 

1  +  Mr( 

,'-t) 

j  "  ( x  .  v  I 

(Ml 

I  lie  lit  si  terms  in  lire  brackets  of  Iqs  ( III)  and  ( I  I )  correspond 
lo  I  be  undillractcd  (tic  or  rein)  orders.  Since  de  components 
are  eliminated  by  spalial  filleting.  l:t|S.  (  It))  and  (II)  can  be 
reduced  lo 


Two  input  signals  s,(l)  and  s,(t)  can  be  represented  by’ 


s,(t)  =  a,(t)cos[<ut  +  <$,('>) 

=  3,(t)+l*(t)  •  Cl 

s,(t)  =  a,(t)cos[iut  +  <>,(!)) 

=  3,<t)  +  !*(»)  .  (2) 

where 

l|(l)  =  -  it(()exp(jsaM)  ,  (31 

3,0)  =  ^  ai(l)exp(j«H)  .  (<l 


g,(x.y-i)  =  jy'i  ( 

1  -  —  j  w  (  X  .  V  1  . 

(12) 

g,(*-y.i)  -  j>3,  ( 

x  \ 

1 1  ’I 

1  -  —  J  W  (  X  .  V  ) 

I  wo-dimensional  Tovuici  spectra  ol  g,(x.\.l)  and 
g,(.x  .  y .  I)  arc  produced  on  the  local  plane  o(  lens  I  ,  I  Ire  light 
dislribulion  (!(«./))  al  the  local  plane  can  be  shown  as 


/  h 

\  /  I*  \ 

0(o. f).l)  =  j 

P,(x-y-y  •’ 

)lg;(x.v.  j  ’) 

/  jh/l\  i  jlr /I  \ 

=  exp  ^ - --  j(i,(n.  /I  II  I  exp  ^  -  J  ti.(o  .  II.  1 1 


*,(l)  =  ■l(t)exp(jipl(t))  .  (5) 

*,0)  =  *,(l)cxp(j ♦,(*))  •  (6> 

Here  3,(1)  and  3,(1)  represent  complex  envelopes  of  s,(t)  and 
s,(t),  respectively,  <p,(l)  and  <£,(t)  represent  phases,  and  <uis  a 
carrier  frequency.  The  superscript  asterisk  represents  the 
complex  conjugate.  The  terms  3,  (t)  and  3,(1).  having  no  nega¬ 
tive  frequency  component,  are  the  analytic  signals  associated 
with  s,(l)  and  s,(t).  The  two  terms  of  Eqs.  (I)  and  (2)  corre¬ 
spond  to  the  downshifted  ( —  I )  diffract  ion  order  and  upshiltcd 
(  +  1)  diffraction  order.  Either  downshifted  or  upshifted  dif¬ 
fraction  order  can  be  observed  in  Dragg  regime  *  In  the  follow¬ 
ing  discussion,  the  downshifted  components  3,  (t)  and  3,(t)  are 
assumed. 


where . '/  denotes  the  2  - 17  spatial  I  tun icr  u ansloi  m  npetalni 
and  (J,(o.f).<)  ami  (i,(o./).l)  me  the  Itunicr  spectin  ol 
g,(x.y.l)  and  g,(x.y.t).  tcspcciivclv 

Intetlerencc  Iringes  will  be  generated  bv  supci position  ol 
O,(o.  0. 1)  and  (i,(o.  ft.  t)  l.cns  I.,  will  mngnils  these  It  inges 
onto  the  square-law  conscrlcr  S  I  lie  intensity  disli  ihulion  al 
the  output  end  ol  the  square-law  converter  can  be  wiiltcn  as 

loic./nil’  =  |tj,(o. fl.tii ’  +  it;. (»./)  ii r 

+  expt  —  jll(l|(i,(it .  /I.  lit  i" In  /I.  II 
f  csp(  .  /?.  f  K  i,( »» .  /?.  1 1  .  MM 

where  flic  ion  coiiMnuf  is  omitictl  Ini  Minplkiu 
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I  liccohcrcnl  readout  ol  the  square-law  converter  induces  a 
light  lield  proportional  lo  |(i(nr.  ft.  t)  | Since  side  lobes  of 
[-  are  negligible,  a  circular  spatial  filter  in  front  of 
lens  I.,,  which  exdacts  interference  fringes  around  the  main 
lobe  of|Ci(c»,/3.t)|2.  can  be  employed  lo  reduce  the  dc  let  el  of 
the  output.  The  transfer  function  of  this  spatial  filter  W'fo.  0) 
and  its  impulse  response  w'(x.y)  are  given  by 


Wfo.0)  = 

,  ,  d! 

1  «!  +  0’<t. 

1)  otherwise  . 

(16) 

ad  /  fill  \ 

wfx.y,  =  (T)  • 

(17) 

where 

p-  =  p’  +  q: 

(18) 

J,  is  the  first-order  Hesscl  function  of  the  first  kind,  and  d  is  the 
diameter  of  the  circular  aperture. 

The  complex  light  distribution  at  the  output  plane  can  be 

shown  as 


where 

r  - 

r,,(x.t)  =  Pa,(t  +  a  +  x  >  n  j  ( t  1  o)<lo  (221 


Therefore,  except  for  the  window  function,  the  cottclnlion 
peak  intensity  is  proportional  to  the  squaic  value  of  the  cross 
correlation  of  a,  and  a. 

If  signal  duration  is  longer  than  the  cell  length  or  the  el  feet 
of  w(x.y)  is  not  ignorablc,  only  partial  correlation  can  be 
obtained  We  note  that  the  cross  correlation  can  be  obtained 
only  if  the  frame  rale  of  the  square-law  converter  is  sulli- 
ciently  high,  bor  example,  if  thes’gnal  lakes  10  us  to  fulfill  the 
aperture  of  the  AO  cell,  the  necessary  frame  rale  is  about  100 
k Hr.  Unfortunately,  with  the  current  stage  of  technology, 
such  a  high  frame  rale  is  not  achievable  in  existing  square-law 
converters. 

Let  us  consider  the  special  case  where  s,(t)  =  s,(t)  = 
2Acosiut.  This  simple  case  is  important  lor  an  application  to 
the  particular  digital  communication  system  such  ns  the  fre¬ 
quency  shilt  keying,  in  which  the  frequency  carries  the  signal 
information.  I  he  analytic  signal  of  2Acosrut  is  given  by 


gfx.y.t)  =  [R„(x,y,t)  +  R,,(x,y.t|+  R„(x.y  -  h.l) 


MU  =  Aexpfjiul) 


+  R„(x.y  +  h.O)  •  W(x.y)  . 


(19) 


We  get  the  joint  transform  power  spectrum  as 


(21) 


where 

Rjjfx.y.O  =  .jf'|CJi<a.0.l)G|(a.0.l)| 

*«• 

=  JJBtfo  +  *.0  +  y.l,yj(a.0.t)dod0 


(20) 


and  the  asterisk  and  the  superscript  asterisk  represent  the  con¬ 
volution  operation  and  the  compux  conjugate,  respectively. 
R,,  and  R2l  are  the  autocorrelation  functions  that  appear  at  the 
origin  of  the  output  plane.  R|;and  R},  are  the  cross-correlation 
terms  (hat  arc  centered  around  y  =  It  and  y  =  — h,  respectively. 
We  note  that  these  cross-correlation  patterns  are  magnilied  by 
lens  L4  for  convenience  of  the  observation. 

Uy  substituting  Eqs.  (3)  and  (4)  into  Eqs.  ( 1 2)  and  ( 13)  and 
ignoring  the  window  effect  (both  w  and  w'),  the  intensity 
distribution  at  y  =  It  can  be  written  as 


|R„(x.0,l)|* 


—  «*  —  «t 


x. /j.Oy'fo. t)dmJ/3 


2 


|G(t>.  0)| 1  =  2y’A’|w  (a  +  7  •  fl) 

+  expf -jh0)  y’A’j W  I  —  .  flj 

+  exp(jh0)y’A!  jw  ^  .  0) 

=  2y’A*|w  |o  +  . /)j|  (Ifcoshp).  (24) 

W(o .0)  =  ab  exp  ^-j  -y-j  sine  ^  —  j  sine  (  )  '  (25) 

where  W(o.0)  is  the  l:ouricr  transform  of  the  rectangular 
window  function  wfx.y)  lime  variable  1  is  omitted  since 
ICifre, 0,l)|*  is  assumed  to  be  quasi  time  independent.  I  he 
inverse  I’ourier  transform  ol  liq  (24)  can  be  shown  as 


gfx-y)  =  y’A'cxp  ^-j  ^  p| 

X  |2R(x.y)  +  Rfx.y  -  h)  +  Rfx.y  f  h)|  .  (26) 

where 

Rfx.y)  =  wfx.y)  ®  w(x.y) 

_  j  (a  -  | x | )  (b  -  |y | )  |x|  <  a.  |y|  <  b  . 

I  I)  otherwise  . 

and  9  denotes  lire  correlation  operation 
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Fig.  3.  Correlation  racalvar. 


3.  THREE-CELL  SYSTEM 

The  system  discussed  above  is  easily  extended  to  a  three-cell 
system  where  three  parallel  AO  cells  ( AO,  are  placed  at  the 
input  plane.  We  assume  that  the  separation  between  AO,  and 
AOj  is  h,  and  between  AOj  and  AOj  is  h2.  For  simplicity,  we 
neglect  the  window  effect  in  the  following  discussion. 

Three  electrical  signals  s,.  *2.  and  s,  fed  into  three  cells 
induce  complex  wave  transmittance  functions  g|t  g2.  and  gj. 
respectively.  On  the  focal  plane  of  the  Fourier  transform  lens, 
the  light  distribution  is  obtained,  similarly  to  Eq.  (14),  as 

G(a,/J,t)  =  exp(-jh,/3)Ol(a./J.I) +  G,(a.0.U 

+  e*P(jh,0)G,(a,/?.l)  .  (28) 

At  the  output  plane,  we  obtain  spatially  separated  cross-corre¬ 
lation  functions  that  correspond  to  each  pair  of  s, ,  s2.  and  s,  at 
points  (0,±h,),  (0,±h2),  and  (0.  ±(h,  +  h2)).  We  note  that  to 
prevent  the  correlation  distributions  from  overlapping  each 
other,  h,  and  h2  must  be  sufficiently  far  apart.  The  expansion 
of  the  above  discussion  to  a  multicell  correlator  is  apparent. 

The  three-cell  system  may  be  significant  for  a  digital  com¬ 
munication  system  in  which  two  different  waveforms  are 
selected  for  transmission  to  the  receiver.  Suppose  that  s,  and 
Sj  are  possible  waveforms  to  be  transmitted  and  that  s2  is  a 
signal  received  by  the  observer.  Since  the  intensity  of  each 
correlation  peak  is  proportional  to  the  intensity  of  the  correla¬ 
tion  function,  the  received  signal  can  be  interpreted  by  a 
simple  decision  rule,1*  such  as 

chooses,  if  intensity  at  (0 .  h , )  >  intensity  at  (0,h2)  , 
choose  s}  otherwise  . 

A  block  diagram  representation  of  the  correlator  is  shown  in 
Fig.  3. 

4.  EXPERIMENTAL  DEMONSTRATIONS 

Theexperiment  was  conducted  with  the  setup  shown  in  Fig.  I. 
We  used  an  LCLV  as  a  square-law  converter.  Since  the 
response  time  of  the  LCLV  is  slow,  the  system  can  be  made  to 
operate  only  for  periodic  signals.  A  pure  sinusoidal  signal  at 
frequency  65  MHe  was  applied  to  both  AO  cells  as  input 
signals  because  the  sinusoidal  signal  makes  the  experiment 
relatively  simple.  The  separation  h  between  two  AO  cells  was 
about  15  mm.  The  aperture  dimensions  a  =  5  mm  and  b  = 
3  mm  were  selected  to  be  sufficiently  small  so  that  a  larger 
main  lobe  can  be  obtained  [see  Eq.  (25) j. 


tt>t 
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Fig.  4.  Ertpeomenfftl  results-  Ini  WoUpii  in  inlprterenee  trlnges. 
|b|  read  oul  Inlrrlcrenep  liinger.  nml  |cl  oulpul  correlation  peaks:  the 
Center  spot  Is  tire  rero  outer  dilliaclion 

Figure  4(a)  slims  s  tin-  inter  lm  ip  <■  1 1  i  1 1  (•  r  s  pi  ml  in  cd  In  the 
phase  dill  cic  me  nl  mmluhiK'il  light  <  run  i  up  li  mu  hut  It  cells. 
1  lie  cosine  term  <>l  I  q  ( 24)  show s  t li;i <  the  li  inpc  si/c  is  etpial 
to  M/h.  where  I  is  the  local  length  ol  lens  I  ,  anti  A  is  the 
wavelength  nl  illumination  I  iguie  >l( l»l  shows  iutctlcirncc 
fringes  written  onto  the  I  Cl  V  I  he  small  ohlirpic  It inges  in 
the  background  tcpicscnl  intci  lr  icnce  due  to  inlet  nal  icllcc- 
tions  within  the  I.CI.V.  Since  the  spatial  liei|iiem  ics  ol  these 
fringes  are  dilfctcnl.  the  intemal  inictlcteme  ran  he  elimi¬ 
nated  by  spatial  lillci ing  I  icmc  l|i  )  show  s  the  output  cnite- 
lalion  peaks  obtained  with  the  setup  ol  I  ip  I 

5.  CONCLUSION 

We  have  demonstmted  an  optita!  auhiteituie  that  ran  he 
applied  to  acousto-optic  spate  inti  gi  at  ing  tout  lalion  I  lie 
correlation  peaks  corresponding  to  ear  h  paii  ol  input  signals 
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can  he  read  out  simultaneously  ai  the  output  plane  with  a 
C'CD  array  camera  lor  signal  interpretation.  The  on-plane 
shut l me  ol  liie  pioposed  lime-signal  optical  correlator  would 
enable  us  lo  implement  the  system  in  a  small  package  by  using 
relatively  lew  optical  components.  I  his  system  may  be  appli¬ 
cable  lo  spread  spectrum  communication  as  a  frequency 
hopping  signal  receiver. 
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ABSTRACT 

A  multichannel  acouuo  opnc  joint  transform  inrrcluior  is  presented 
On-plane  acouuo  optic  tAO)  sells  and  a  square  Ion  lonierter  ore  ern- 
ployed.  The  AO  tells  are  driven  hi  j requeues  iiiultiplesed  temporal 
signals  to  produce  ipatialls  mittlitlotcd  signals  The  toini  transform  pnner 
spectrum  is  generated  nith  a  square  tan  mitt  crier  Pi  on  eric  f  anner 
transformation  with  a  coherent  readout,  the  trass  torrehinon  of  input 
signals  can  he  obtained  Suite  the  arshilei  line  tan  protest  wideband 
signals,  it  niyi  he  applied  to  detest  multiple  frequents  shift  An  my 
tMFSK)  signals 


1.  INTRODUCTION 

Recently,  we  have  introduced  an  optical  atiliilcclurc  for  an 
acousto-optic  (AO)  correlator  based  on  optical  joint  transform 
correlation  |l)  Two  parallel  on  plane  AO  cells  were  used  to 
produce  cross  correlation  between  two  temporal  signals  We 
have  noted  that  the  proposed  svstem  is  capable  of  processing 
signals  that  are  modulated  by  frequency  shift  keying  (I  SK) 

In  this  article  we  will  expand  the  concept  for  a  multiple 
AO  cell  system  that  deals  with  multiple  frequenev  signal',  so 
that  higher  communication  throughput  can  be  obtained  The 
proposed  multiccll.  nntltifrequcncy  ssstcm  is  suitable  for  the 
application  of  detecting  multiple  frequenev  shift  keying 
(MFSK)  communication  signals 
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2.  ARCHITECTURE 

Figure  1(a)  shows  a  schematic  diagram  of  an  acousto-optic 
joint  transform  correlator  (AJTQ.  This  system  consists  of  an 
array  of  AO  cells  at  the  input  plane  and  a  liquid  crystal  light 
valve  (LCLV)  which  acts  as  a  square-law  detector  for  the 
composite  Fourier  to  power  spectrum  conversion.  The  geo¬ 
metrical  locations  of  the  AO  cells  at  the  input  plane  are 
depicted  in  Figure  1(b).  One  of  the  AO  cells,  which  is  referred 
to  as  a  reference  cell,  is  driven  by  a  local  reference  signal 
r„(r).  We  assume  N  -  1  number  of  signals  r„(r),  received 
from  a  communication  path,  are  fed  into  the  other  N  -  1  AO 
cells,  which  are  called  signal  cells.  If  all  the  signal  cells  are 
equally  spaced  on  the  right-hand  side  of  the  input  plane,  the 
reference  cell  would  be  placed  on  the  left-hand  side  at  a 
distance  Nh  apart  from  the  optical  axis,  where  h  is  the 
spacing  of  the  signal  cells.  Thus,  the  cross  correlations  among 
received  signals  would  be  diffracted  within  a  distance  ( N  -  2)h 
from  the  optical  axis,  while  the  cross  correlation  between 
reference  and  received  signals  would  be  diffracted  away  from 
those  undesired  correlation  spots. 

Now  assume  that  the  input  signals  r„(r)  are  narrowband 
signals,  which  can  be  decomposed  into  the  sum  of  two  ana¬ 
lytic  signals 

*„(')  -*.(»)  +  V(»)  "-0,1,2 . N-  1  (1) 

The  corresponding  transmittance  functions  of  the  AO  cells 
can  be  approximated  by  (2) 

*JVA<~  x/v)wm(x.y) 

n  -  0,1,2 . N  -  1  (2) 

where  y  and  w„(x,  y)  are  the  modulation  depth  and  the 


window  function  of  the  AO  cells,  respectively.  Note  that  the 
window  function  represents  not  only  the  aperture  size,  but 
also  includes  the  uniformity  of  illumination,  misalignment 
factor,  and  roughness  of  the  crystal  Thus,  the  light  distribu¬ 
tion  emerging  from  the  AO  cells  can  be  written  as 

*(x.  y,  t)  -g0 (x.y  +  (N  -  l)h,i) 

N-  l 

+  E  *»(*.  y-  h(n  -  1),  l)  (3) 

m  —  1 

The  Fourier  transform  of  the  above  equation,  through  a 
transform  lens  L,.  can  be  projected  onto  the  input  end  of  a 
square-law  converter  (i.e.,  LCLV).  The  lens  L?  was  used  to 
magnify  the  joint  Fourier  spectra,  such  that  the  interference 
fringes  would  be  within  the  resolution  limit  of  the  LCLV 
Since  the  readout  light  field  of  the  square-law  converter  is 
proportional  to  the  square  modulus  of  this  Fourier  transform, 
we  have 

|£(a,0tf)|2-  £  \Gm(a,P,t)\ 

it  -  o 

V-  1 

+  £  G0{a,fi,t)G;(a,P,t) 

n  —  l 

xexp[  jh(  N  +  n  -  2) ] 

N-  1 

+  £  (70* (a,  p,  l)c„(a,p,  t) 

n  —  \ 

xexp[  -jh(  N  +  n  -  2)] 

+  *£  *£  (  « ,  0 ,  0  GJJ  (  * .  /? ,  f ) 

«-  l  l 

xexp[ -jh(  n  -  m)|  (4) 


i  <b> 


Rflur#  1  (a)  Mullicell.  mullifrcquencv  acousto-optic  joint  transform  correlator  AO„ .  v  ,.  acousio  optic  cells  / ,  and  I  ,  transform  lenses, 

f.,  and  I.,.  magnification  lenses.  S.  square-lass'  converter.  BS,  beam  splitter.  F  spatial  filler  (7.  grating  (b)  The  input  plane  geometrs  of  the 
mullicell  svstem 
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where  t)  are  Fourier  transform  of  g„(jr,  yt  r). 

The  complex  light  distribution  at  the  output  plane  would 
be 

v- 1 

<i-0 

s  - 1 

+  E  R0n(p<<i  +  h(N  +  n  -  2 ),t) 

<1—1 

V- l 

+  E  *„o(  P<  ?  -  M  ^  +  »  -  2),  f) 

*1—1 

+  E  E  R*m(P'<l  -  M»  ~m)'0  (5) 

rt  —  1  *»  —  1 

where 

<?•')-  /  /  «,(“  +/>•£  +  ?.') 

—  oo  —  oo 

Xgm(<*-0'O  (6) 

The  first  summation  of  Eq.  (5)  represents  the  autocorrelation 
terms  of  the  input  signals,  which  are  diffracted  at  the  origin  of 
the  output  plane.  The  second  and  third  summations  corre¬ 
spond  to  the  cross  correlations  between  the  reference  and  the 
input  signal  terms,  which  are  diffracted  in  the  vicinity  of 
(0,  ±h(N  +  n  -  2)).  These  correlation  spots  can  be  separated 
if  the  spacing  h  is  sufficiently  large.  The  last  summation 
represents  the  undesired  cross  correlations  of  the  input  sig¬ 
nals,  which  would  be  diffracted  within  the  distance  ( N  -  2)h 
from  the  optical  axis.  Notice  that  these  terms  are  separated 
from  the  desired  reference  to  input  signal  correlation  spots. 

Also  note  that  the  correlation  spots  from  the  second  and 
third  summations  represent  the  frequency  content  of  the  input 
signals,  if  they  match  the  reference  frequencies.  The  position 
of  each  correlation  spot  indicates  that  the  signal  cell  has  the 
same  frequency  components  as  the  reference  cell.  Because  the 
frequency  components  are  diffracted  to  the  same  correlation 
spots,  the  actual  temporal  frequencies  cannot  be  determined. 

To  overcome  this  problem,  gratings  of  different  spatial 
frequencies  are  added  behind  the  square-law  converter  as 
shown  in  Figure  1(a).  A  linear  array  of  bandpass  spatial  filters 
were  also  introduced  to  reduce  the  zero-order  diffraction  com¬ 
ponent.  Since  the  AO  celts  diffract  incident  light  at  different 
angles,  a  series  of  Fourier  spectra  along  the  vertical  axis  can 
be  obtained.  If  a  signal  contains  one  of  the  frequency  compo¬ 
nents  of  the  reference  cell,  linear  interference  fringes  would  be 
produced  in  the  corresponding  Fourier  spot,  which  determines 
the  horizontal  location  of  the  output  correlation  spots.  The 
gratings  behind  the  square-law  converter  will  separate  the 
superimposed  correlation  spots  in  the  vertical  direction.  One 
of  the  possible  arrangements  of  the  output  correlation  spots  is 
shown  in  Figure  2.  The  correlation  spots  within  the  dashed 
box  represent  the  frequency  content  of  the  input  signal  cells. 

Two  experimental  demonstrations  using  the  three  AO  cells 
were  conducted  in  our  laboratory,  where  the  center  cell  was 
used  as  the  reference  signal.  In  the  first  demonstration,  a 
signal  with  frequencies  of  SO  MHz  and  49.75  MHz  was 
applied  to  all  the  AO  cells.  Circular  spatial  filters  4  mm  in 


p 


Figure  2  Output  correlation  spots 


(a) 


M 

* 


<b» 

Figure  3  Experimental  results  for  a  three  sell  ssstcm  (a)  Output 
correlation  spots  obtained  with  matching  two  frequencies  (h)  Output 
correlation  spots  obtained  with  matching  one  of  ihe  frequencies 
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diameter  and  grating  frequencies  of  4  and  8  lines/nun  were 
used  in  the  experiment.  For  convenient  illustration,  photo¬ 
graphic  film  was  used  as  the  square-law  converter.  Figure  3(a) 
shows  the  (our  output  correlation  spots  obtained  with  this 
experiment.  In  the  second  experimental  demonstration,  signals 
of  50  MHz  and  49.75  MHz  were  respectively  applied  to  each 
of  two  signal  cells.  Output  correlation  spots  corresponding  to 
each  of  the  applied  frequencies  are  shown  in  Figure  3(b).  The 
frequency  content  of  the  signal  cells  can  be  identified. 


3.  RECEIVER  CONFIGURATION 

Since  efficient  diffraction  by  the  AO  cell  occurs  at  the  Bragg 
angle,  the  signal  should  be  implemented  around  the  Bragg 
frequency.  The  incoming  wideband  signal  is  divided  into  small 
subbands  that  At  into  the  bandwidth  of  AO  cells.  The  center 
frequency  of  each  subband  is  then  translated  to  the  Bragg 
frequency  before  being  input  to  the  AO  cells.  We  assume  that 
there  are  N  -  1  signal  cells  and  that  each  subband  has  M 
frequency-division  channels.  Then  the  system  can  deal  with 
M(N  —  I)  channels  simultaneously. 

A  block  diagram  of  the  proposed  receiving  system  is  il¬ 
lustrated  in  Figure  4.  TV  Arst  frequency  converter  selects  the 
appropriate  communication  band,  and  demodulates  the  signal 
to  the  intermediate  frequency  which  is  the  Bragg  frequency  of 
the  system.  The  secondary  frequency  converters  are  used  to 
translate  the  center  frequency  of  the  subbands  to  the  ap¬ 
propriate  Bragg  frequency  of  the  AO  cells.  After  bandpass 
Altering,  these  signals  are  fed  into  an  array  of  AO  cells. 
Output  correlation  spots  can  be  read  out  by  photodiode  array 
detectors.  By  passing  these  detected  correlation  spots  through 
a  thresholding  logic  network,  the  highest  probable  received 
signal  can  be  displayed  at  the  system  output.  The  basic 
bottleneck  of  the  proposed  system  is  the  square-law  converter 


(eg,  LCLV),  in  which  the  response  time  is  in  the  order  of 
milliseconds. 

4.  CONCLUSION 

In  conclusion  we  would  like  to  point  out  that  the  proposed 
architecture  is  capable  of  processing  very  wide  bandwidth 
temporal  signals,  as  high  as  10*  resolution  elements  The 
proposed  AO  correlator  can  be  synthesized  in  compact  form 
The  operation  of  the  system  is  rather  simple,  (or  it  eliminates 
the  complicated  electronics  circuitry  usually  required  for  data 
processing.  However,  the  proposed  system  requires  the  avail¬ 
ability  of  a  square-law  converter  with  higher  speed  and  larger 
dynamic  range.  Thus,  the  realization  of  a  practical  joint  trans¬ 
form  AO  correlator  for  MFSK  communication  applications 
would  be  dependent  upon  the  rapid  development  of  a  qualified 
device  in  the  future. 
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Figure  4  A  black  boa  representation  of  an  acousto-optic  frequency 
hopping  signal  receiver 
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Optical  signal  detection  by  complex  spatial  filtering  can  be 
traced  back  to  1964,  when  it  was  developed  by  VanderLugt1 
Since  then  the  concept  has  been  widely  used  for  various  types 
of  large-capacity  optical  correlator.1-*  One  of  them  is  a 
scanning  correlator  system  using  a  rotating  grating.4-* 
Gregory  and  Huckabee  reported  a  correlator  addressed  by  an 
acoustooptic  cell.1  Recently  liquid  crystal  television 
(LCTV)  has  found  some  interesting  applications  to  optical 
signal  processing,  e.g.,  optical  pattern  recognition  and  adap¬ 
tive  joint  transform  correlation.*-10  In  this  Letter  we  pro¬ 
pose  a  technique  in  which  a  scanning  grating4  can  be  easily 
imposed  on  an  LCTV  screen  with  a  microcomputer.  The 
setup  is  depicted  in  Fig.  1.  The  proposed  system  overcomes 
the  positioning  difficulty  caused  by  either  the  mechanical 
movement  or  the  frequency  shift  in  the  techniques  men¬ 
tioned  above. 1-0 

Because  the  low  resolution  of  LCTV  limits  the  spatial 
carrier  frequency,  we  use  a  new  setup  which  is  little  different 
from  a  conventional  optical  correlator.  The  lens  system  Lj- 


Fig.  I .  Multichannel  optical  correlator  using  an  addressable  LCTV. 
L,  and  L\,  collimating  system;  L,  and  L,,  transform  lenses;  L j, 
magnifying  lens;  P\  and  Pi,  polarizers;  BS,  beam  splitter;  M,  mirror. 

APPLIED  OPTICS  /  Vol.  27,  No.  18  /  15  September  1988 


Lj  is  used  to  project  a  reduced  image  of  the  LCTV  grating 
onto  the  input  plane  of  the  optical  correlator,  so  that  the 
Fourier  transform  of  the  object  can  be  of  the  proper  scale 
while  the  spatial  frequency  spectrum  of  the  grating  is  magni¬ 
fied.  The  different  diffraction  orders  on  the  frequency 
plane  can,  therefore,  be  sufficiently  separated.  We  further 
note  that  the  pixel  size  of  the  LCTV  is  ~390  |im,  so  the 
highest  spatial  modulating  frequency  for  the  input  object  in 
a  conventional  4-/ system  is  — 1 .25  !ines/mm.  In  our  system, 
a  carrier  frequency  of  12  lines/mm  is  obtained.  A  higher 
carrier  frequency  can  be  achieved  by  adjusting  the  lens 
system,  and  the  spatial-bandwidth-product  of  the  system 
remains  the  same.  The  transmittance  of  the  LCTV  grating 
image,  including  the  polarizers,  can  be  approximately  writ¬ 
ten  as 

u(*.y>- K,+K,[rect(’ ;  ■  j)*comb(*  ■  *)] 

x  j^rect  •  comb  *  J  ■  (1) 

where  K i  and  Kj  are  proportionality  constants,  a.b  are  the 
pixel  image  size  in  the  x  and  y  directions,  respectively,  c.d  are 
the  distances  between  the  centers  of  adjacent  pixel  images,  g 
and  h  are  the  width  and  spacing  of  the  image  grating  grooves, 
and  X  represents  the  orientation  of  the  grating  vector,  which 
i*  given  by 

X  ■  x  cos*  +  y  sind  (2) 

The  Fourier  transform  of  the  input  object  with  the  modulat¬ 
ing  function  of  Eq.  (1)  can  be  written  as 

VUJy)  -  .  !«(/,,/,)  +  sinda/,,6/,)  combtc/,.df,1| 

X  IsinctiL,)  combth/*)!,  (3) 

where  V(J,Jy)  “  7|ii(x,y)|,  and  o(x,y)  is  the  input  object 
function. 

For  a  detailed  analysis  of  the  recording  of  the  matched 
filters  and  the  correlation  operation  refer  to  Refs.  4  -6  and  1 1. 
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Fig.  2.  Experiment*!  results:  the  recorded  multiple  matched  filter 
(on  one  plate). 
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Fig.  3.  Experimental  results: 
autocorrelation  peaks  of  eight  input  objects. 
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Fig.  4. 

Experimental  results:  autocorrelation  and  cross¬ 
correlation  peaks  obtained  with  the  filter  for  warning 
plane. 


We  set  adjustable  delays  between  the  subroutines,  longer 
delays  (minutes)  for  filter  construction,  and  shorter  delays 
(seconds)  for  target  detection.  To  multiplex  the  matched 
filters  onto  a  recording  plate,  we  change  the  orientation  and 
period  of  the  grating  via  the  microcomputer.  During  the 
detection,  the  orientation  and  period  of  the  grating  are  auto¬ 
matically  changed  once  again.  As  soon  as  the  autocorre¬ 
lation  peak  appears  at  the  output  plane,  which  means  the 
input  image  has  been  recognized,  the  scanning  is  terminated; 
otherwise  it  is  continued. 

As  an  experimental  demonstration,  multichannel  spatial 
filters  of  eight  input  objects  were  recorded  on  a  holographic 
plate,  as  shown  in  Fig.  2.  The  output  peaks  related  to  the 
input  objects  are  shown  in  Figs.  3  and  4.  From  these  results, 
we  see  that  a  multichannel  correlating  operation  can  be 
achieved  by  using  a  programmable  LCTV  grating. 

A  programmable  scanning  correlator  using  a  low-cost 
LCTV  has  been  implemented.  This  technique  alleviates  the 
positioning  problem  of  the  mechanically  scanning  method. 


The  scanning  speed  of  the  proposed  correlator  is  primarily 
limited  by  the  microcomputer  and  the  response  time  of  the 
LCTV.  Furthermore,  if  a  higher-resolution  LCTV  is  avail¬ 
able,  both  the  input  object  and  modulating  grating  can  be 
superimposed  onto  the  LCTV  screen.  Thus  a  program¬ 
mable  real-time  electrically  addressed  co.r»lator  may  be 
realized. 

We  acknowledge  the  support  by  U.S.  Air  Force,  Rome  Air 
Development  Center,  Hanscom  Air  Force  Base,  MA.  under 
contract  F19628-87-C-0086. 
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optical  mode  that  is  caused  by  the  high-frequency  reference, 
h  is  the  length  of  the  reference  arm,  di  is  the  propagation 
constant,  w,  is  the  electrical  reference  frequency  in  radians 
per  unit  time,  and  t  is  the  time.  It  is  assumed  that  the 
amplitude  A  of  the  optical  signals  in  both  the  channels  are 
equal.  The  light  wave  in  the  signal  arm  at  the  output  junc¬ 
tion  of  the  interferometer  is  given  by 

S  “  A  C0S(w„r  +  m2  sin(u,(  +  A$)  +  r32/2). 


where  12  is  the  signal  arm  length,  d2  is  the  propagation  con¬ 
stant  in  the  signal  arm,  m2  is  the  amplitude  of  the  sinusoidal 
change  of  the  phase  of  the  optical  mode  that  is  caused  by  the 
signal,  and  &<t>  is  the  phase  difference  between  the  signal  and 
reference  voltage.  The  two  optical  waves  from  the  two  chan¬ 
nels  will  interfere  at  the  output  junction  of  the  Mach- 
Zehnder  modulator,  and  the  resulting  amplitude  corre¬ 
sponds  to  the  sum  of  S  and  R  given  by  T  =  S  +  R. 

The  dc  component  of  the  optical  intensity  as  seen  by  a 
detector  at  the  output  is 


7* 


«/0(mi)J0(m2) 
0.5  + - - 


cos(d2lj  -  (9,1,) 


+  J,(m,)J,(m2)  coa(02l2  -  0,1,  +  A <t>) 


Integrated-optic  Mach-Zehnder  rf 
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In  rf  signal  processing  applications,  the  determination  of 
the  rf  signal  phase  is  sometimes  required.  For  example,  in 
radar  direction  finding,  the  signal  direction  can  be  obtained 
from  the  phase  difference  between  detected  rf  signals  from 
two  spatially  separated  antennas.  In  such  situations  elec¬ 
tronic  signal  processing  of  the  received  signals  is  employed  to 
determine  this  phase  difference;  acoustic  and  acoustooptic 
technique*  of  rf  signal  phase  evaluation  have  been  dis¬ 
cussed.'-2  However,  systems  employing  these  techniques 
are  fairly  limited  in  frequency  response.  These  techniques 
have  been  employed  to  determine  the  phase  angle  to  better 
than  0.3®  at  25%  bandwidth  at  operating  frequencies  below  1 
GHz.3 

We  describe  a  novel  high-frequency  phase  comparator 
based  on  a  large  signal  modulation  of  light  in  an  integrated 
optic  Mach-Zehnder  interferometer.  In  this  device  two 
high-frequency  electrical  signals  are  fed  into  the  electrodes 
on  the  two  channels  of  the  Mach-Zehnder  modulator.  The 
phase  difference  of  the  two  signals  is  measured  by  determin¬ 
ing  the  optical  intensity  of  the  output  of  the  modulator. 

The  schematic  diagram  of  the  phase  comparator  is  shown 
in  Fig.  I.  The  input  light  to  the  device  is  divided  equally  into 
two  channels.  The  light  wave  in  the  reference  arm  of  the 
output  junction  of  the  interferometer,  modulated  by  the 
reference  signal,  is  given  by 

R  “  A  costive  +  m,  sin(u,()  +  0,1,), 

where  cvo  is  the  optical  frequency  in  radians  per  unit  time,  mt 
is  the  amplitude  of  the  sinusoidal  change  of  the  phase  of  the 


+  </2(m,)J2(m2)  cos (02l2  -  0,1 1  +  2A<r>) 

+  </3(m,)t/3(m2)  cos(02l2  —  0,1 ,  +  3A$)  .... 

where  Jn  is  the  Bessel  function  of  the  order  n  (n  is  an  integer). 
Large  amplitudes  of  modulation  cause  large  nonlinearities  in 
the  modulator  output,  and  the  effective  number  of  Bessel 
terms  in  the  expression  are  increased. 

The  Mach-Zehnder  modulator  channels  were  ~3.5  ^m 
wide  and  designed  for  single-mode  operation  at  0.6328  Mm. 
The  waveguides  were  fabricated  on  x  -cut  lithium  niobate  for 
y-propagation.  To  fabricate  the  waveguides,  235-A  thick 
titanium  strips  were  diffused  into  the  substrate  for  3.5  h  at 
!000®C.  Aluminum  electrodes  of  3.8-mm  length,  4-^m  gap, 
and  6-jim  width  were  deposited  onto  the  substrate  with  the 
gap  centered  on  the  channels. 


1  flfCTRODC 

Fig.  1.  Schematic  of  the  Mach-Zehnder  modulator.  It  consists  of 
titanium-diffused  waveguides  in  x-cut  lithium  niobate  for  y-propa¬ 
gation  with  aluminum  electrodes  deposited  on  both  waveguide  arms. 
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ABSTRACT 

A  progranimahle  real  time  optical  tomt  transform  t  nrrelntor  ih  it  gener¬ 
ates  sharper  autocorrelonon  peaks  is  presented  A  mu  mi  hunnel  r pniuil 
light  modulator  is  utilized  as  the  threshold  hard  c  lipping  square  lass 
device.  A  liquid  crystal  television  is  used  in  duplets  the  inpul  targe I  and 
reference  image.  The  basic  principle  of  the  ssstern  and  a  preliminary 
experimental  result  are  given 

I.  INTRODUCTION 

Because  of  its  high  processing  speed  and  structural  simplicity, 
an  opticaJ  joint  transform  correlator  has  heen  proposed  for 
the  application  to  pattern  tccognition  With  advancing  tech¬ 
nology.  various  schemes  to  perform  real-time  joint  transform 
correlation  have  been  reported  |l.  2|  Nevertheless,  all  the 
existing  techniques  have  a  common  drawback,  namely,  that 
the  correlation  peak  intensity  is  only  a  serv  small  fraction  of 
the  illumination  inlcnsitv  This  low  intensity  presents  no  ma¬ 
jor  problem  if  input  signal  to  noise  ratio  (SNR)  is  high. 
Whenever  the  SNR  is  low.  however,  the  detection  of  the  signal 
becomes  increasingly  more  dillicult  Using  a  phase-only 
matched  filler  (3)  can  improve  the  dill  taction  cllicicncy  of  the 
correlation  peak  many  fold  Nevertheless,  a  phase  onlv  filter  is 
difficult  to  realize  in  practice  with  the  current  state  of-thc-art 
elcctrooptic  devices 

In  this  article,  we  will  introduce  a  real- time  programmable 
joint  transform  correlator  utilizing  the  threshold  hard-clipping 
property  of  a  microchannel  spatial  light  modulator  (MSLM) 
[4|.  We  will  show  that  this  technique  is  capable  of  producing 
sharper  autocorrelation  peaks  than  the  conventional  optical 
correlator  By  combining  the  advantages  of  the  state-of-the-art 
elcctrooptic  devices  and  flexibility  of  a  microcomputer,  the 
system  can  be  built  as  an  adaptive,  self  learning  correlator 
The  operating  principle  of  the  technique  and  a  preliminary 
experimental  demonstration  arc  given 

It.  BACKGROUND 

A  MicroChannel  Spatial  l  ight  Mt'duhuor  I  lie  MSI.M  is  a 
reflective  lv->e  elcctrooptic  spatial  light  modulator  It  consists 
of  a  photocathodc.  imaging  electrodes,  a  microchannel  plate 
(MCP).  a  mesh  electrode,  and  an  clcctrooptical  (l:.Ot  crystal 
plate  positioned  in  a  sealed  vacuum  tube  In  operation,  the 
write-in  image  projected  on  the  photocathode  creates  a  spatial 


photoelectron  distribution.  The  electrostatic  lens  images  the 
distribution  onto  the  MCP.  After  a  103  to  104  electron  multi¬ 
plication  by  the  MCP,  the  electrical  charge  image  is  deposited 
on  the  inner  side  of  the  EO  crystal  plate.  This  charge  distribu¬ 
tion  induces  a  spatially  varying  electric  field  within  the  crystal 
plate.  The  field  in  turn  modulates  the  phase  retardation  be¬ 
tween  the  X  and  Y  components  of  the  read-out  light  that 
makes  a  double  pass  through  the  plate.  Passing  the  light 
through  an  analyzer,  a  coherent  optical  image  corresponding 
to  the  input  image  is  obtained.  One  unique  feature  of  the 
MSLM  is  that  when  the  bias  voltages  are  properly  controlled, 
the  device  can  perform  quite  a  number  of  optical  operations 
in  its  internal  mode  processing. 


B.  Joint  Transform  Correlator.  The  principle  of  the  classical 
joint  transform  correlator  (JTC)  is  well  documented  by  Weaver 
and  Goodman  (5).  To  compare  it  with  the  proposed  MSLM 
based  system,  we  shall  briefly  discuss  its  operation  in  a  spe¬ 
cific  example.  For  simplicity,  we  suppose  both  the  target  and 
the  reference  image  at  the  input  plane  are  binary  type  with 
square  apertures  of  width  w.  The  main  separation  between 
them  is  /.  The  amplitude  transmittance  function  of  these  input 
objects  can  be  expressed  as 


/(*.?) 


X  -  1/2 

W 


+  reel 


x  +  1/2 

w 


(i) 


where  the  rectangular  function  is  defined  as 

tv 

if  W  5  - 

otherwise 

If  the  input  objects  are  illuminated  by  a  collimated  coher¬ 
ent  light,  the  complex  light  field  at  the  back  focal  plane  of  a 
transform  lens  would  be 


sin(rrwr)  sin( 

n)  -  c - cos(u7m 

irw  iFfi 


(2) 


where  c  is  a  proportionality  constant  and  p  and  v  are  spatial 
frequency  coordinates,  corresponding  to  the  X  and  Y  direc¬ 
tions,  respectively.  If  this  complex  light  field  is  imaged  onto  a 
square-law  convertor  (eg.,  a  photographic  plate),  then  the 
recorded  amplitude  transmittance  can  be  written  as 

(  -  t0  -  P\bF\2  (3) 

where  f„  and  ft  are  the  bias  transmittance  and  the  slope  of  the 
T-E  (transmittance  vs.  exposure)  curve,  respectively. 

In  linear  approximation,  we  would  use  a  linear  piecewise 
model  to  represent  the  T-E  curve.  Thus,  Eq.  (3)  can  be 
approximated  by 


put  plane  would  be 


g(.x,  y) 


i  r  l 

t  •* 


(5) 


where  A  is  the  illumination  amplitude,  and  A  repr.  a 
triangular  (unction  defined  as 


if  (x|  £  w 
otherwise 


In  view  of  Eq.  (5),  the  intensity  of  the  correlation  peaks  is 
about  .-42/16w4.  Moreover,  the  illustrated  technique  is  not  a 
real-time  technique.  In  the  following  discussion  we  shall, 
however,  describe  a  programmable  hard-clipping  JTC  using  a 
MSLM. 


Ml.  BASIC  PRINCIPLE 

The  schematic  diagram  of  a  microcomputer-based  JTC  is 
shown  in  Figure  1  The  liquid  crystal  plate  of  a  LCTV  is  used 
to  display  a  real-time  target  and  a  reference  image  at  the  input 
plane  of  an  optical  processor.  The  working  principle  of  the 
LCTV  as  an  optical  element  is  well  known  The  major  advan¬ 
tage  of  using  a  LCTV  must  be  programmability,  which  can  be 
addressed  with  a  microcomputer,  for  the  generation  of  various 
reference  images.  The  telescopic  imaging  lenses  are  employed 
to  demagnify  the  input  object  images  from  the  LCTV  to  an 
appropriate  size  and  then  transformed  onto  the  MSLM  We 
shall  use  the  MSLM  as  a  threshold  hard-clipping  device  The 
output  light  field  is  detected  by  a  CCD  camera.  This  detected 
electrical  signal  can  be  sent  to  a  TV  monitor  for  observation 
or  fed  back  to  the  microcomputer  for  further  instruction 
Thus,  in  principle,  an  adaptive  hybrid  electrooptic  correlator 
could  be  constructed. 

Let  us  assume  that  the  target  and  reference  image  are  the 
same  as  expressed  by  Eq.  (1).  The  light  intensity  distribution 
at  the  input  end  of  the  MSLM  would  be 


=cJ 


sin(i7>v(')  sinjmv/i) 

•nV  TTfl 


cos(  rr/v ) 


(6) 


Notice  that  the  grid  structure  of  the  LCTV,  which  is 
beyond  the  resolution  limit  of  the  MSLM.  is  omitted  To 
obtain  a  btnanzed  power  spectral  distribution  for  joint  trans¬ 
form  correlation,  the  bias  voltages  of  the  MSLM  are  adjusted 
such  that  only  those  parts  of  the  input  with  intensitv  values 
above  the  threshold  level  will  be  responded.  This  hard-clip¬ 
ping  property  of  the  MSLM  converts  the  input  irradiance 
l(y,  fi)  into  a  series  of  binary  phase  distributions,  between  the 
X  and  Y  components  of  the  read-out  light,  as  depicted  in 
Figure  2.  By  binarizing  the  central  lobe  of  Eq.  (6)  using  the 
half-power  criterion,  the  output  phase  function  can  be  ob¬ 
tained  with  the  first-order  approximation,  as  given  by 


t  -  1  -  a 


sin(irwv)  sin(irtvji) 


cos(  nlv) 


(4) 


where  a  is  a  proportionality  constant.  Since  t  ^  0,  the  maxi¬ 
mum  value  of  a  is  aml,  -  1/w4. 

Taking  the  inverse  Fourier  transform  of  the  preceding 
equation,  the  autocorrelation  functions  distributed  at  the  out- 


r  -  "H  it;  )  f,  1 9  *( "  i ) 

(2) 

where  ®  denotes  the  convolution  operation  This  equation 
represents  a  truncated  binary  phase  grating  After  emerging 
from  the  polarizing  beam  splitter  (FBS),  the  complex  light 
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LCTV  L,  Lj  L 3  PBS  L,  /’< o  CCD  Camera 


Figure  t  The  schematic  of  a  programmable  optical  joint  transform  correlator  /,.  coherent  input  illumination;  -  /.4 .  lenses;  PftS.  polarizing 

beam  splitter;  l0.  He-Ne  laser  read-out  illumination;  P0,  output  plane 


field  becomes 


(8) 


where  A  is  the  amplitude  of  the  read-out  light. 

Using  straightforward  manipulation  to  inverse  transform 
Eq.  (8),  the  output  autocorrelation  functions  can  be  shown  as 
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To  compare  the  performance  of  the  binarized  JTC  with  the 
conventional  JTC,  we  see  that  the  correlation  peak  intensity  of 
the  proposed  system  is  about  A2/ir2w4,  whereas  for  the 
conventional  JTC  the  correlation  peak  intensity  would  be 
A1/I6w*.  In  other  words,  the  correlation  peak  intensity  of  the 
proposed  system  would  be  about  1.62  times  higher  than  that 
of  the  conventional  one,  under  the  same  illumination.  More¬ 
over,  if  the  bias  voltages  can  be  controlled  such  that  the 
threshold  hard  clipping  takes  place  at  a  lower  intensity  level  to 


r  r 


Figure  2  The  conversion  of  the  input  light  intensity  to  the  output 
phase  retardation  for  an  MSLM  in  threshold  hard-clipping  mode 


Figure  3  Simulated  correlation  peaks  (normalized  by  )  for  a  I  x  I -mm  binary  input  pattern  I .  correlation  peak  by  the  classical  JTC.  2.  bv  the 
proposed  technique  with  threshold  hard  clipping  applied  to  (he  central  half  of  the  mam  lobe  of  Eq  (6).  J.  with  threshold  hard  clipping  mc  lud.ng 

the  whole  main  lobe  of  Eq  (6) 
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ABSTRACT 

An  optic  ull  i  ( nnlrolleil  imtrouate  attenuator  it  dccaiheil  7 hr  hulk 
semiconductor  properties  of  cadmium  selenitic  ore  th  roonuroted  effec¬ 
tively  01  Ku  hand  frequencies  The  deuce  ir  cnnfijtiued  monnhtlucalls 
with  a  Ion-  capacitance  resislire  channel  f  lee  meal  retonance  n  uthteicd 
noth  ssnimetric  indue  lance  loops  which  bridge  the  channel  ends 

I.  INTRODUCTION 

There  exist  numerous  situations  which  require  control  of 
microwave  signals  F.lccitonically  variable  attenuators  are 
available  for  frequencies  up  to  200  (illr  these  attenuators 
may  lake  the  form  of  TIN  diodes  or  field  cITcct  transistors 
(FETs)  At  higher  frequencies  junction  capacitance  limits  de¬ 
vice  usefulness  A  more  serious  concern  deals  with  decoupling 
the  control  signal  from  the  RF  signal  path  I  he  utility  of  a 
variable  resistor  under  the  control  of  incident  optical  illumina¬ 
tion  is  obvious  Cadmium  sulfide  photoconductivc  cells  have 
been  employed  in  a  wide  variety  of  industrial  applications  for 
more  than  40  years  In  fact,  the  characteristic  distributed 
resistance  of  these  devices  may  result  in  large  chip  areas  with 
the  power  handling  capability  up  to  several  watts  Commercial 
pholoconductive  cells  typically  employ  a  serpentine  resistance 
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TABLE  1  Comparison  ot  CPU  Time  between  the 
FFT  Summation  Schama  and  the  Conventional  Brute-Fore* 
Summation  on  ttia  Cray  X-MP  /  48  lor  a  Free-Standing 
Frequency  Selective  Surface 


No.  ol 
Unknowns 

CPU  (sec) 

FFT 

Summation 

Brule-Force 

Summation 

24 

0.127 

0449 

60 

0  165 

1  1 35 

112 

0.267 

2  286 

TABLE  2  Comparison  ol  CPU  Time  between  the 
FFT  Summation  Scheme  and  the  Conventional  Brute-Force 
Summation  on  the  Cray  X-MP  /  48  lor  Signals  over  a 
Periodically  Perforated  Ground  Plane 


CPU  (sec)  for  7  iterations 

No.  of 

FFT 

Brute- Force 

Unknowns 

Summation 

Summation 

148 

3  843 

20.673 

CONCLUSIONS 

A  numerically  efficient  summation  technique  using  the  FFT 
for  the  method  of  moments  solution  to  electromagnetic  prob¬ 
lems  associated  with  planar  periodic  structures  is  presented. 
Numerical  results  for  the  scattering  problem  from  a  frequency 
selective  surface  and  the  transmission  problem  from  signal 
lines  over  a  periodic  perforated  ground  plane  are  presented  to 
demonstrate  the  superior  numerical  efficiency  of  the  present 
technique  over  the  conventional  brute-force  summation 
scheme.  This  technique  is  especially  well  suited  for  the  eigen¬ 
value  problems  associated  with  planar  periodic  structures. 
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ABSTRACT 

A  joint  Fourier  transform  processor  can  he  used  as  a  tnnrrntnnuil 
coherent  optic  til  prnt  error  In  prim  iple.  lilt-  jmnt  transform  prat  cssnr  ,  an 
perform  till  the  optical  data  protesting  that  a  torn vniinmil  inherent 
optical  processor  can  offer.  Sample  illustrations  for  signal  curat  lion  and 
image  subtraction  are  given.  The  major  advantages  of  the  joint  transform 
processor  must  he  ll)  the  avoidance  of  synthesising  a  matthed  spatial 
filter,  1 2 )  higher  space-bandwidth  product.  O)  lower  spatial  turner 
frequency  requirement,  (4)  higher  output  diffraction  efficient  s  ,  etc 

In  a  conventional  coherent  optical  signal  processor  |1|,  the 
processing  operation  is  usually  carried  out  at  the  spatial 
frequency  or  Fourier  plane  with  a  complex  spatial  filter  f 2 J. 
This  type  of  coherent  optical  processor  oilers  a  myriad  of 
complicated  processing  operations  (3)  Its  success  is  primarily 
due  to  the  profound  diffraction  phenomena.  We  shall,  in  this 
letter,  point  out  that  complex  signal  processing  can  also  be 
achieved  by  the  spatial  impulse  response  using  a  joint  trans¬ 
form  processor  |4-6|.  There  are  several  inherent  advantages  of 
using  the  joint  Fourier  transform  processor  as  compared  with 
the  conventional  coherent  processor:  (1)  spatial  filter  adjust¬ 
ment  is  not  imposed;  (2)  a  higher  input  space-bandwidth 
product;  (3)  generally,  a  higher  modulation  index  of  the  joint 
transform  hologram;  (4)  lower  spatial  carrier  frequency,  etc. 
In  view  of  these  advantages,  a  joint  transform  processor,  in 
principle,  is  capable  of  performing  optical  signal  processing 
more  efficiently,  particularly  in  the  application  to  real-time 
signal  processing  16] 

Let  us  now  consider  a  joint  Fourier  transform  optical 
signal  processor  as  depicted  in  Figure  1  We  assume  an  object 
function  f(x,  v)  is  inserted  at  (ou, 0)  and  a  spatial  impulse 
response  h{x.  v)  is  placed  inverledly  at  (  -o,.0)  in. the  input 
plane  P}.  By  illuminating  the  input  objects  with  coherent  light, 
the  complex  light  distribution  at  the  Fourier  plane  P,  is  given 
by 

U(p,q)  =  F(  p ,  q)  e"'or  +  ir(p.q)e  (1) 

where  (/?,  q)  represents  the  angul^-  spatial  frequency  coordi¬ 
nate  system,  the  superscript  ast  '  represents  the  complex 
conjugate,  and 

F(p,q)  -*■(/(«.>•) | 

IHp,q)  =jr[h(x,  v  )  ] 

where  &  denotes  the  Fourier  transformation  Thus,  at  the 
output  end  of  the  square  law  detector,  the  intensity  distribu¬ 
tion  is  given  by 

Hp-q)  ~  |L(p.7)l; 

”  I  F(  p.q)  |J  -v  |  //(  p.q)\' 

+  F{  p.  q)  ll[  p.q)  e'""r 

+  F'{  p,q)ll"(  p.q)e  (2) 
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Figure  1  A  joint  Fourier  transform  processor.  BS,  beam  splitter 


By  coherent  readout  of  this  intensity  distribution,  the  com¬ 
plex  light  distribution  at  the  output  plane  would  be 

g(x,  y)  -/(x,  y)0/(x,  y)  +  h(-x,  -y)Qh(-x,  y) 

+/(x,  y)*h{x  +  2 a0,  y) 

+/(-•*.  ~y)*H -x  -  2a0,  -y)  (3) 

where  0  donotes  the  correlation  operation  and  •  denotes 
the  convolution  operation.  Thus,  we  see  that  two  sets  of 
convolution  operations,  i.e.,  the  object  function  f(x,  y)  con¬ 
volves  with  the  spatial  impulse  response  h(x,  y),  are  diffracted 
around  (-2ao,0)  and  (2ao,0),  respectively. 

Similarly,  if  the  spatial  impulse  response  h(x,  y)  is  prop¬ 
erly  placed  (i.e.,  not  inverted)  at  the  input  plane,  e.g., 
h(x  +  a0,  y),  the  output  light  distribution  can  be  shown  as 

*(*.>')  ~  J(x,  y)Q/(x,  y)  +  h(x,  y)Qh(x,  y) 

+f(x,  y)(7)h(x  +  2a0,  y) 

+f(-x,-y)Qh(-x  -  2a0,-y)  (4) 

where  Q  donotes  the  correlation  operation.  From  Equations 
(3)  and  (4)  we  notice  that  the  joint  Fourier  transform  system 
can  be  used  as  a  coherent  optical  data  processor.  In  principle, 
it  can  perform  all  the  optical  data  processing  that  a  conven¬ 
tional  coherent  optical  processor  can  offer. 

We  shall  illustrate  an  application  to  extraction  of  a  signal 
embedded  in  a  random  noise.  We  assume  that  a  target  is 
embedded  in  an  additive  white  Gaussian  noise,  as  given  by 

/(*-  ao.  y )  ”  *(*  -  «o.  y)  +  »(*  -  <*<>•  y )  (5) 

where  r(x,  y)  represents  the  target  function  and  n(x,  y)  is 
the  noise  distribution.  If  the  spatial  impulse  response  is  given 
by 

*(■*  +  °o.  y)  -  *(•*  +  °o.  y)  (6) 


Since  n(x,  y)  is  an  additive  white  Gaussian  noise,  we  note 
that  [7] 

*(x,  y)®*(*'  >)  ~  0  (g) 

Thus  Equation  (8)  reduces  to 

«(x,  y)  -  2r(  x,  y)0j(r,  y)  +  n(  x.  y)@n(  x.  y) 

+  s(x.  y)0i(i  +  2n0,  y) 

+  i( -x,  -y)@r( -x  -  2a„.  -y)  (9) 

From  this  result,  we  see  that  two  autocorrelation  functions  of 
the  target  object  will  be  diffracted  in  the  output  plane  around 
(-2a0,0)  and  (2a0,0),  respectively.  For  experimental  demon¬ 
stration,  a  computer  simulated  object  of  this  application  is 
shown  in  Figure  2.  From  Figure  2(b),  we  see  that  two  highly 
visible  correlation  peaks  are  obtained  in  the  output  plane  One 
of  the  apparent  advantages  of  the  joint  transform  correlation 
must  be  the  advoidance  of  the  matched  filter  synthesis.  This 
technique  is  very  suitable  for  application  to  the  real-time 
pattern  recognition. 

Let  us  now  illustrate  a  second  application  to  image  sub¬ 
traction.  We  assume  that  the  objects  at  the  input  plane  are 
given  by 

/,(x  -  a0.  y)  +  S(x,  y)  +/2(  -x  +  a„.  -y)exp(  nr)  (10) 

where  8(x,  y)  is  a  delta  function,  exp(iw)  represents  a  half¬ 
wave  phase  plate,  and  /,(x,  y)  and  /,(x,  y)  are  real  objects 
The  intensity  distribution  at  the  output  end  of  the  square 
law  detector  can  be  shown  as 

l(p,q)  -  1  +  |/j(  p,  </)|:  +  |E:*(  p.  q)\: 

+  [V(  P-q)  ~  fj* 

+  1  Fi(p.q)  -  F:{p.q)}e 
-F](p.q)F1(p.q)'  ':"nr 
-Fx'(p.q)FS(p.q)e'^r  (11) 


then  from  Equation  (4),  the  output  complex  light  distribution 
can  be  shown,  such  as 

g(x,  y)  -  [r(x,  y)  +  n(x,  y)]Q[r(x,  y)  +  n(x.  >■)] 

+  r(x,  y)0r(x,  y) 

+  [r(x,  y)  +  n(x.  y)l0r(x  +  2a„,  y) 

+  (r(  -x,  -y)  +  n(  -x,  -y )] 

X©r( -x  -  2a0, -y)  (7) 

where  0  denotes  the  correlation  operation. 


where  the  superscript  asterisk  denotes  the  complex  conjugate. 

By  coherent  readout  of  Equation  (11),  the  output  complex 
light  field  would  be 

g(  x,  y )  -  S(  x.  y )  +/,(  x,  >■)©/,(  x.  i  ) 

+/:(-x.  -v)0/;(- x.  -i) 

+  [/i(  -x  +  o„.  -y)  -  /;(  -  x  +  n„.  -l  )| 

+  [  A(  x  -  a„.  y)  -  /,(  x  -  a„.  I  )| 

~A(x.  y)  *  /:(  x  -  2n„ .  v ) 

-/,(  -x.  -})•/,(  -  x  +  2o„.-v)  (12) 
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FlguT*  3  Image  subtraction  (a)  Input  objects  (b)  Subtracted  image 
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where  (*)  and  •  denote  the  correlation  and  the  convolution 
operations,  respectively.  In  view  of  Equation  (12),  we  see  that 
two  sets  of  subtracted  images  will  be  dilTracted  around 
(-a0,0)  and  (a0,0),  respectively.  A  computer  simulation  of 
this  application  is  shown  in  Figure  3,  where  Figures  3(a)  are  , 
the  input  objects  and  Figure  3(c)  shows  the  corresponding 
subtracted  image  obtained  by  this  technique. 

In  conclusion,  we  would  stress  that,  in  principle,  the  joint 
transform  processor  can  perform  all  the  processing  that  a 
conventional  coherent  optical  processor  can  olTer.  The  inher¬ 
ent  advantages  of  the  joint  transform  processor  are  (I)  the 
avoidance  of  complex  spatial  filter  synthesis,  (2)  a  higher  input 
space-bandwidth  product,  (3)  lower  spatial  carrier  frequency 
requirement,  (4)  generally  higher  output  diffraction  efficiency, 
and  many  others. 
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SUMMARY  :  Pseudocolor  encoding  is  *  commonly  used  en¬ 
hancement  procedure  for  grey  level  images.  One  of  the  classical 
techniques  for  three  color  white  light  pseudocolor  encoding  was 
presented  by  Yu  era/,  (lj.  In  this  paper  a  variation  of  this  three 
color  encoding  method  will  be  described  that  uses  moire  fringe 
patterns  from  two  encodings  to  carry  the  Information  previously 
obtained  from  the  third  encoding.  Both  a  theoretical  description 
and  experimental  results  are  presented. 


Un  procldl  de  codage  en  fausses  couleurs  en  deux 
{tapes  et  ft  trols  couleurs 

RESUMt  :  Le  codagc  en  lausscs  couleurs  cst  un  precede 
classique  pour  amfliorer  le  rendu  des  ni'eaus  de  gris  dans  une 
image.  L'une  des  techniques  les  plus  eonnucs  pour  le  codape  c.i 
Irois  couleurs  en  lumiite  blanche  a  dtd  pif  senr<e  par  >  u  er  at  1 1 1 
On  d<crit  dans  cel  article  une  varianic  de  cc  ptoccdf  J  trois 
couleurs  qui  utilise  le  tfscau  des  Ranges  de  mtritf  de  ileus 
codages  pour  le  troisieme  codagc  Le  principc  et  les  rfsultats 
expgrimentaux  sonl  ptfsentfs 


1.  —  INTRODUCTION 

Frequently,  high  resolution  optical  information  is 
encoded  through  the  use  of  grey  level  images.  A 
common  enhancement  process  used  to  aid  in  the 
analysis  of  these  images  is  pseudocolor  encoding.  A 
number  of  methods  to  accomplish  the  encoding  have 
been  developed  that  use  coherent  (2|,  as  well  as 
incoherent  white-light  sources  (3).  One  of  the  Drst 
methods  was  proposed  by  Yu  «f  af.  (lj.  The  process 
described  in  Yu’s  paper  uses  three  sequential  spatial 
encodings  of  the  positive,  negative,  and  the  product 
of  the  positive  and  negative  images.  A  white-light 
source  was  used  and  the  three  components  were 
processed  using  red,  blue,  and  green  filters  to 
produce  the  output  image.  A  shortened  variation  of 
this  procedure  will  be  described  in  this  paper  in 
which  the  three  components  are  achieved  using  only 
two  spatial  encodings. 


II.  —  DISCUSSION 

The  image  show  n  in  figure  la  will  be  used  to  help 
illustrate  the  process.  The  image  is  comjwscd  of 
three  distinct  grey  levels  :  while,  grey,  and  black.. 
The  figure  la  image  was  contact  printed  to  obtain 
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the  negative  image  shown  in  figure  lb.  To  facilitate 
the  encoding  procedure,  pin  registration  was  used 
during  the  contact  printing  operation.  Next,  the 
positive  image  was  encoded  using  a  sampling  grating 
oriented  as  shown  in  figure  2a.  The  negative  was 
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Fio.  2d.  —  Encoding  of  positive  image. 


then  encoded  with  the  sampling  grating  rotated  by 
an  angle  0  with  respect  to  the  previous  encoding,  as 
shown  in  figure  2b.  The  cumulative  result  of  the  two 
encodings  is  shown  in  figure  2c.  Note  the  moire 
pattern  that  is  formed  in  the  grey  areas. 

The  intensity  transmittance  of  the  encoded  image 
can  be  written  as 

(x,y)  -  K  {r,(x.  >-)ll  +  sgn  (cospx)J 
+  Tg(x,y)[\ 

+  sgn  (cosp(Jt  cos  0  +  y  sin  0  )))'  y  ,  (1) 


/  /  /  /  /  /  /  /  /  / 


FlO.  2r.  —  Result  of  two  encodings,  note  nunre  pattern 


where  K  is  a  proportionality  constant,  7,  and 
Tj  are  the  positive  and  negative  image  exposures,  p 
is  the  spatial  encoding  frequency,  y  is  the  film 
gamma,  and 


sgn 


(.cos  x )  =  {_ 


1 ,  cos  x  ^  0  . 
1,  cos  x  <  0 


(2) 


The  resulting  transparency  is  then  bleached  to 
obtain  a  surface  relief  phase  object  Assuming  that 
this  encoding  is  within  the  linear  region  of  the 
diffraction  efficiency  versus  log-exposure  curse,  the 
amplitude  transmittance  can  be  written  as 


f  (r,  y)  =  exp  (i<7>  (r, >  )|  .  .  (3) 


where  <f>(r,y)  represents  the  phase  delay  distri¬ 
bution  which  is  proportional  to  7  (r ,  y ).  the  exposure 
of  the  encoded  Him. 

Placing  the  bleached  transparency  at  the  input  of  a 
white-light  processing  system,  the  complex  light  lield 
at  the  Fourier  transform  plane  can  be  determined  by 
evaluating  the  integral 


S(a,p  ;  A  ) 


jj  r(x,y)exp[-i  ~  (ax,  Py) j  dr  dy 
||  exp(i<f>(xty)l  expj^-  i  ~-j  (ax,  Py )j  dr  d> 


(4) 
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The  transmittance  function  exp[i^  (x,  y)]  can  be  expanded  to  obtain 

S(a,  p  ;  A  )  =  ||  |l  +  i<#»  (x, > )  +  1  (i<f>(x,y)l2  +  •••  J  x  exp[~  '  7J  ( ax ’  P>')]  d*  dy  •  (5) 

Substituting  Eq.  (3)  into  (5)  and  retaining  the  first  order  terms,  the  following  expression  results 
S(a,  p  ;  A  )  =  f,  ja  ♦  J~P'  &  J  +  A  |a  *  cos  0.  P  +  P  sin  0  j  +  f,  ja  ±  J~P<  &  }  * 

Ti  { a  +  P  cos  0.  P  +  ^  P  sin  } 

+  f2  ( a  -  p  cos  0  .  p  -  p  sin  0  J  ’  ^ 

l  2  n  2  n  I 

where  ft  and  f2  are  the  Fourier  transforms  of  Tj  and  T2,  •  denotes  the  convolution  operation.  The 
proportionality  constants  have  been  neglected  for  simplicity.  The  convolution  term  can  be  written 


f,(a.  P  )  *  t2(a,  p  )  • 


6  ( a  ±  p[l  +  cos  0  J,  P  +  ^ - p  sin  0 }  + 
l  2  fr  2  tr  J 

s  ja  ±  ~  cos  0),  p  -  J^psin  @J 


which  shows  the  locations  of  the  moire  spectra. 


The  moire  pattern  can  be  decomposed  into  a  two 
dimensional  signal  that  has  fundamental  periods  in 
the  directions  shown  in  figure  3.  This  pattern  is  in 


Fic.  3.  —  Dashed  lines  indicate  orientation  of  fundamental  periods 
for  the  moire  pattern. 


agreement  with  the  convolution  terms  given  in  Eq. 
(6).  Figure  4  shows  the  diffraction  pattern  formed  by 


Flo.  4.  —  Image  of  diffraction  pattern  produced  by  encoded 
transparency. 


the  encoded  transparency.  If  filters  are  placed  in  the 
Fourier  plane  as  shown  in  figure  5,  the  image 
irradiance  at  the  output  plane  becomes 

/(*.y)  =  Tftjr.y)  +  Tl(x,y )  + 

+  |rt(x,y)r:(x,y)|  ,  (8) 

thus,  the  image  irradiance  expressed  by  Eq  (8)  is 
the  superposition  of  the  positive,  negative,  and 
cross-product  terms. 


FlC  5.  —  Location  of  fillers  in  Founrr  plane  for  reconstructed 
image. 
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III.  —  RESULTS  AND  CONCLUSIONS 

Ad  image  of  an  aluminium  fracture  specimen 
obtained  from  a  scanning  electron  microscope  was 
used  for  this  discussion.  Positive  and  negative  images 
were  then  encoded  using  a  sampling  grating  having 
40  lines/mm  on  Kodak  5460  microfilm.  To  balance 
the  intensities  between  the  primary  and  convolved 
spectra,  neutral  density  filters  were  used  along  with 
the  color  fdters  for  the  positive  and  negative  spectra. 


As  can  be  seen  in  figure  6b,  the  output  of  the 
pseudocolor  encoded  image  represents  a  consider¬ 
able  improvement  over  the  black  and  w  hite  image  in 
that  the  fine  detail  structure  of  the  image  has  been 
enhanced.  Figure  6c  shows  the  cross-product  term 
produced  by  the  moire  pattern.  By  using  this  new 
procedure,  the  pseudocolor  encoding  was  ac¬ 
complished  using  a  single  sampling  grating,  and  two 
rather  than  three  exposures.  This  allows  greater  use 
of  the  dynamic  range  of  the  film  by  eliminating  one 
exposure.  This  method  also  illustrates  an  interesting 
application  of  moire  patterns. 

We  acknowledge  ihe  support  of  the  U.S.  Air  Force.  Rome  Air 
Development  Center,  Hanscom  AFB,  Mass.,  under  contract  no. 
F19628-87-C-0086. 


Fig.  6c.  —  Cron-product  of  image  recorded  by  moire  pattern. 
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Abstract.  Experimental  implementation  of  a  holographic  optical  associa¬ 
tiva  memory  system  using  a  thresholding  microchannel  spatial  light  mod¬ 
ulator  (MSLM)  is  presented.  The  first  part  of  the  system  Is  basically  a  joint 
transform  correlator,  In  which  a  liquid  crystal  light  valve  Is  used  as  a 
square-law  converter  for  the  Inner  product  of  the  addressing  and  Input 
memories.  The  MSLM  is  used  as  an  active  element  to  recall  the  associated 
data.  If  the  device  Is  properly  thresholded,  the  system  Is  capable  of  Im¬ 
proving  the  quality  of  the  output  image. 

Subjtct  terms:  optical  signal  processing:  holographic  associative  memory:  Image 
processing;  spatial  light  modulators:  neural  networks. 
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In  this  paper,  we  present  a  system  using  an  active  micro- 
channel  spatial  light  modulator  (MSLM)  to  improve  the  readout 
process.  With  the  hard  clipping  properly  of  the  MSLM,  and  at 
the  sacrifice  of  shift  invariance,  we  were  able  to  improve  the 
quality  and  increase  the  intensity  of  the  addressing  beams  so 
that  high  quality  recalled  data  were  obtained.  Experimental  re¬ 
sults  for  binary  objects  are  provided. 


I.  INTRODUCTION 

It  is  well  known  that  optical  associative  memory  can  also  be 
defined  as  fault  tolerant  memory,1  which  can  be  addressed  by 
a  partial  or  distorted  input  object  to  recall  the  stored,  and  possibly 
noise-free,  information.  The  technique  has  significant  applica¬ 
tions  to  optical  pattern  recognition  and  image  processing. 

The  concept  of  optical  associative  memory  can  be  traced  back 
as  early  as  the  work  published  by  Van  Heerden2  and  later 
strengthened  by  the  holographic  associative  memory  of  Gabor  .1 
Their  techniques  are  often  called  the  ghost  image  method.  With 
the  recent  surging  activities  in  neural  networks  (e  g.,  Refs. 
4-6),  several  optical  associative  memory  architectures  have  been 
developed.1'7'  1  Different  methods  to  perform  the  inner  product 
operation  for  optical  associative  memory  have  been  investigated. 
For  instance,  Paek  and  Psaltis  demonstrated  a  method  using  a 
Vander  Lugt  correlator  lo  implement  the  inner  product  of  the 
input  object  and  reference  data.7  The  stored  data  can  then  be 
nridrc.sNcri  with  llic  delected  correlation  peak  by  pinhole  sam¬ 
pling  To  improve  the  storage  capacity,  Owechko  et  al.  used  an 
angularly  multiplexed  Fourier  hologram  technique.1  They  used 
a  phase  conjugate  mirror  to  address  the  Fourier  hologram. 


Invited  Paper  IA- 105  received  Nov  19.  1988;  revised  manuscript  received  tan. 
It.  19X9;  accepted  for  publication  Feb.  15.  1989 
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2.  PRINCIPLE 

The  iwodimensional  outer  product  associative  memory  can  be 
expressed  in  the  inner  product  form  as7 


h(x 


y>  “  b„(x,y) 


(l) 


where  f(|,q)  is  the  system  input  function,  h(x,y)  is  the  corre¬ 
sponding  system  output,  fm(£,q)  is  the  mth  reference  memory, 
hm(x,y)  is  its  associated  output  pattern,  and  M  is  the  total  number 
of  stored  memories. 

Equation  (I)  shows  that  the  overall  process  is  composed  of 
three  steps,  namely,  inner  product  (the  input  object  with  refer¬ 
ence  data),  multiplication  (the  inner  product  with  the  associated 
memory),  and  summation. 

Our  experimental  setup  lo  implement  the  above  process  is 
shown  in  Fig.  I .  The  first  half  of  the  system  is  a  joint  transform 
correlator  with  an  addressing  object  and  multiple  reference  data 
(input  memories)  at  the  input  plane  Pt.  The  second  half  of  the 
system  has  an  active  MSLM  to  improve  the  quality  of  the  output 
addressed  data.  In  operation,  the  addressing  data  and  multiple 
reference  fur.clions  are  Fourier  transformed  by  lens  L|.  The  joint 
transform  power  spectrum  is  delected  by  the  square-law  con¬ 
vener  liquid  crystal  light  valve  (LCLV).  By  inversely  Fourier 
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where  (x)  denotes  the  correlation  operation  and  c  is  a  propor¬ 
tionality  constant. 

Note  that  as  long  as  the  quantity  x  ,  -  Mxi  is  larger  than  the 
distance  between  two  adjacent  correlation  peaks,  they  can  he 
detected.  When  the  MSLM  is  adjusted  in  its  thresholding  mode, 
the  input  and  output  light  intensities  are  related  by'2 


l.fx.y) 


Al.U.y) 
0  . 


If  l.tx.y)  a  lT  , 
otherwise  , 


(5) 


Fig.  1.  Holographic  associativa  mamory  systam  using  an  activa  MSLM. 
P,— Input  plana;  Pi — hologram  plana;  Pj— output  plana;  SP— sam¬ 
pling  pinholas;  PBS — polarising  baam  spllttar. 


transforming  the  power  spectrum  with  lens  L|,  we  obtain  a  group 
of  correlation  peaks.  To  eliminate  all  of  the  unwanted  light,  a 
set  of  sampling  pinholes  (SPs)  is  used.  Only  selected  correlation 
peaks  can  be  written  onto  the  MSLM.  If  the  addressing  object 
is  most  similar  to  one  of  the  stored  memories  (i.e.,  the  reference 
functions),  its  correlation  peak  will  be  the  strongest.  Thus,  the 
output  of  the  MSLM  can  be  considered  as  a  spatially  encoded 
array  of  light  sources,  with  the  strength  of  each  source  propor¬ 
tional  to  the  correlation  peak  value.  If  we  have  an  array  of  Fourier 
transform  holograms  inserted  at  Pi  in  accordance  with  the  as¬ 
sociation  rule,  a  recalled  image  (addressed  data)  can  be  seen  on 
the  output  plane  Pj.  The  analytical  description  of  the  process  is 
given  in  the  following. 

For  simplicity,  we  assume  that  the  addressing  function  and 
input  memories  are  lined  up  along  the  x  axis.  The  amplitude 
transmittance  of  the  input  plane  is  given  by 


where  L(x.y)  and  Mx,y)  are  the  write-in  and  readout  light  in¬ 
tensities  of  the  device,  A  is  an  arbitrary  constant,  and  It  is  the 
intensity  threshold  value.  Thus,  only  the  correlation  peak  inten¬ 
sities  exceeding  the  threshold  value  would  be  responded  at  the 
output  end  of  the  MSLM.  By  setting  lr  at  a  reasonably  low 
value  and  blocking  out  all  but  the  second  term  in  Eq.  (4)  with 
the  SP,  the  readout  light  field  of  the  MSLM  can  be  explicitly 
expressed  as 

m  f 

i„  -  C|  y  Iftlx-  2x0-mxi,y)f(x-2x0-mxi,y)dxdy  ,  (6) 

M -  lJ 

where  C|  is  a  proportionality  constant  and  the  asterisk  denotes 
complex  conjugation. 

To  complete  the  operation,  a  spatially  multiplexed  Fourier 
transform  hologram  is  inserted  in  Pj  plane,  in  which  the  sub¬ 
hologram  lakes  the  form 

Hm(p.q)  -  F|h„(x.y)exp[  -j^  x(2x0  -  mx,)lj  , 


M 

t(x.y)  -  f(x-Xo,y)  +  X  f«.(x  +  x«  +  mxi,y)  ,  (2) 

m  -  I 

where  xo  and  xt  are  two  constants  and  M  is  the  number  of  input 
memories.  The  Fourier  power  spectrum  at  the  input  side  of  the 
LCLV  can  be  written  as 

M 

E(p.q)  -  |F(p,q)|'  +  X  F(p,q)FS(p,q)exp|  -j(2x,  +  mx,)p| 

I 

M 

+  X  F*(p,q)Fm(p,q)explj(2x0  +  mx,)p| 

«  ■  I 
M  H 

+  X  X  F:<p.q)F„<p.q)exp(j<m  -  n)x,p|  ,  (3) 

m  -  I  a  -  I 

where  F(p,q)  and  Fm(p,q)  are  the  Fourier  transform  of  f(x,y) 
and  fn«(x,y),  respectively.  Notice  that  the  amplitude  transmit¬ 
tance  of  the  LCLV  is  proportional  to  the  intensity  distribution 
of  its  input  end.  Therefore,  the  light  field  distribution  on  the  SP 
is  the  inverse  Fourier  transform  of  Eq.  (3),  i.e., 

W*.y)  “  c£f(x,y)  ®  f(x.y)  +  X«*.y>®  f«(x-2x,-mxi>y) 

M 

+  X  f(x  +  2x#  +  mxi.y) 

m  ■  I 

MM  1 

+  X  Xf«(x.y)®  f«(x  +  (B-m)X|,y)  I.  (4) 

"»  ■*  t  n  -  I  j 


m»  1.2 . M  .  (7) 

where  X  is  the  wavelength  of  illumination,  f  is  the  focal  length 
of  the  inverse  Fourier  transform  lens  Lj,  and  F  represents  the 
Fourier  transform  operation.  IT  the  hologram  is  aligned  in  a 
position  such  that  each  llm  is  exactly  illuminated  by  the  mr/i 
term  of  Eq.  (6),  then  the  light  held  at  the  output  plane  Pj  can 
be  shown  as 

h’(x,y)  -  c,  X||^{r»<t'nlf<C1l),ltdnjli,„(x.y) 
f  ,2n  ,  1 

x  exp  -j—  x(2x0  -  m«i)  .  (8) 

Except  the  exponents,  the  above  equation  is  the  same  as  the 
outer  product  associative  memory  of  Eq.  (I),  in  which  f„,  is 
assumed  to  be  a  real  function.  We  further  note  that  the  exponents 
of  Eq.  (8)  represent  oblique  plane  wavef'oots,  which  result  in» 
undesired  interference  fringes  at  the  output  plane  Pj  It  is  ap¬ 
parent  that  if  X|  is  made  adequately  large,  the  interference  fringes 
can  be  removed  from  the  output  retrieved  data  by  a  low  pass 
spatial  filtering  technique. 

A  very  interesting  feature  of  the  system  is  its  controllability. 
For  example,  if  the  MSLM  is  set  at  a  reasonably  low  threshold 
value  such  that  all  of  the  peaks  at  the  SP  are  responded  at  the 
output  end  of  the  MSLM.  the  output  is  the  weighted  sum  of  the 
associations  as  expressed  by  Eq  (8)  On  the  other  hand,  if  the 
threshold  value  of  the  MSLM  is  adjusted  to  allow  only  the 
highest  correlation  peak  intensity  at  the  SP  to  be  responded  at 
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llic  readout  end  of  llic  device,  we  can  call  it  the  winner-lake- 
ull  Then  the  complex  output  light  of  Eq.  (8)  reduces  to 


h”(x,y)  =  c 


I  jw 

[-S 


x  exp 


Jhm(x,y) 
<2x«  -  in*,)] 


(9) 


which  is  proportional  to  h,„(x,y).  Notice  that  in  the  above  equa¬ 
tion,  f,„  is  the  input  memory  closest  to  the  addressing  function. 
Thcrcfoie.  the  process  can  be  interpreted  as  the  retrieval  of  the 
inhumation  that  has  the  shortest  Hamming  distance  to  the  inr/t 
memory,  Furthermore,  il  h,„(x,y)  is  equal  lo  fm(x,y),  the  system 
is  an  auloassocialive  memory  system;  otherwise,  it  is  heleroas- 
sociutive. 


3.  EXPERIMENTAL  RESULTS 


Because  of  easy  implementation,  the  experimental  demonstra¬ 
tions  are  for  "winner-lake-alT 1  auto-  and  heleroassociative  mem¬ 
ories.  The  first  consideration  in  the  experiment  is  the  number  of 
input  memories  to  be  used.  Under  the  ideal  condition  (i.e.,  the 
addressing  object  and  the  nu/i  input  memory  are  identical  and 
noise  free  and  the  transmittance  dynamic  range  of  the  LCLV  is 
from  2cro  lo  one),  the  null  correlation  peak  intensity  value  at 
the  SP  can  be  expressed  as 


I 

it  +  M)4Jfjo,0)|4 


JUt.ml’dtdT, 


(10) 


where  M  is  (he  number  of  input  memories  and  Fm(0,0)  is  the 
dc  component  of  the  tnr/i  memory  This  equation  shows  that  the 
autocorrelation  peak  intensity  on  the  SPs  dramatically  decreases 
as  the  number  ol  input  mcmoiies  increases.  From  a  physics  point 
of  view,  this  decrease  is  due  to  the  effect  of  mutual  modulation 
between  the  input  memories.  The  effect  results  in  low  diffraction 
efficiency  of  the  LCLV.  When  the  autocorrelation  peak  is  too 
weak,  the  poor  signal-to-noise  ratio  will  make  the  thresholding 
MSLM  not  operate  properly.  Thus,  for  easy  demonstration  we 
used  three  input  memories  fi  e.,  M  =■  3)  in  our  experiment. 

Another  problem  we  need  to  consider  is  the  resolution  re¬ 
quirement.  The  size  of  the  SPs  has  to  be  very  small  (about 
200  pm)  in  order  to  gel  the  correlation  peak  (inner  product) 
values  only.  Therefore,  direct  readout  of  the  pinholes  onto  the 
Fourier  transform  holograms  will  produce  poor  resolution  on  the 
output  data  because  of  the  loss  of  high  frequency  components. 
To  overcome  this,  wc  used  an  imaging  lens  (not  shown  in  Fig.  I) 
to  enlarge  the  SPs  onto  the  input  window  of  the  MSLM.  Thus, 
lire  illumination  beam  size  on  each  subhologram  can  be  made 
large  enough.  By  using  this  method,  the  small  pinhole  size  does 
not  pul  much  limitation  on  the  system  resolution. 

In  (he  experiment,  the  bias  voltages  of  the  MSLM  were  set 
so  that  the  device  responded  only  to  the  brightest  correlation 
peak.  Figure  2  shows  the  experimental  results  obtained  from  the 
auloassocialive  memory.  We  used  "penn”  as  the  addressing 
object  and  the  other  three  words  as  the  reference  functions.  In 
our  experiment,  we  blocked  a  portion  of  the  addressing  object 
and  then  adjusted  the  intensity  threshold  value  of  the  MSLM  lo 
examine  the  variations  in  the  output  response.  We  have  observed 
that  wltr-t  the  input  is  about  50%  of  the  input  memory,  the 
system  can  still  produce  a  satisfactory  output  result  We  also 
tried  blocking  different  parts  of  the  addressing  object.  The  sys- 
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Fig.  2.  Experiment*!  results  obtained  Irom  the  eutoessodetlve 
memory.  (e)-fd|  Addressing  lunctlon  end  reference  memories; 
lel-lh)  corresponding  output  responses. 


Tern  responded  satisfactorily.  For  example,  when  we  blocked 
the  lower  half  of  the  word  "penn,”  the  output  data  showed  little 
difference  from  the  result  of  Fig.  2(h)  subjectively 

Figure  3  demonstrates  a  set  of  experimental  results  of  the 
heleroassociative  memory.  These  results  were  obtained  by  ar¬ 
ranging  ihe  memory  bank  (i.e  ,  the  Fourier  transform  hologram 
of  “Optical  Computing")  according  to  our  association  rule. 
When  Ihe  input  is  a  complete  function  (i.e.,  "penn”),  a  satis¬ 
factory  output  response  can  be  obtained,  as  shown  in  Fig  3(a). 
If  the  addressing  function  is  a  partial  object  as  given  in  Figs 
2(b)  to  2(d),  the  corresponding  output  responses  Ishown  in  Figs. 
3(b)  lo  3(d)|  deteriorate  somewhat  hut  are  still  recognizable.  The 
system  with  a  complete  addressing  function  can  be  viewed  as  a 
symbolic  substitutes  as  noted  by  Huang. 15  On  ihe  other  hand, 
the  system  with  an  incomplete  addressing  function  can  be  re¬ 
garded  as  a  inference  machine  as  introduced  by  Caulfield.14 

The  above  experimental  results  show  the  feasibility  of  the 
Technique.  We  believe  that  if  the  input  and  input  memories  are 
preprocessed  by  an  edge  enhancement  technique  and  the  holo¬ 
grams  are  optimally  recorded  on  dichromated  gelatin  lilin,  the 
performance  of  the  system  can  be  further  improved. 

4.  CONCLUDING  REMARKS 

We  have  presented  a  holographic  associative  memory  system 
with  a  controllable  MSLM  Since  the  MSLM  is  used  as  an  active 
device  in  the  system,  Ihe  quality  of  the  output  addressed  data 
can  be  improved  as  compared  with  a  passive  holographic  method 
Another  advantage  of  the  system  is  its  controllability,  by  which 
Ihe  memory  addressing  mode  can  be  adjusted  to  either  "winner- 
take-all"  or  "weighted  sum"  operations  Ihe  joint  transform 
method  has  Ihe  merit  of  easy  system  alignment  and  real-time 
filler  synthesis.  Il  is  apparent  that  if  programmable  spatial  light 
modulators  were  used  at  the  input  plane  F,  and  the  hologram 
plane  P2  and  a  feedback  loop  were  constructed  between  them, 
the  memory  capacity  of  the  system  could  be  further  enhanced 
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reeults  from  the  complete  and  partial  addressing  functions  of  Figs. 
2(a)-2(d),  respectively. 
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Two  digital  optical  architectures  utilizing  a  binary  number  encoding  technique  for  multiple  malrix  multiplication  are  presented 
An  inner-product  method  with  grating  masks  is  used  in  one  •  f  the  architectures,  so  that  multiple  matrix  multiplication  can  be 
performed  in  parallel.  The  second  architecture,  a  mixture  o  systolic  array  and  the  inner-product  processing  method  are  used 
These  two  architectures  can  offer  high  accuracy  with  moderate  speed  processing  capability. 


1.  Introduction 

Optical  matrix  multiplication  is  one  of  the  prom¬ 
inent  areas  in  optical  computing.  In  early  1970’s,  Lee 
et  al.  [  1  ]  proposed  a  method  to  perform  multiple 
matrix  multiplication  using  Fourier  transform  prop¬ 
erty  of  lenses.  Another  technique  was  later  devel¬ 
oped  by  Nakano  et  al.  [  2  ] .  They  utilized  a  linear  ar¬ 
ray  of  LED’s  along  with  a  combination  of  spherical 
lenses  and  cylindrical  lenses  to  perform  triple  matrix 
multiplication.  Several  other  methods  have  also  been 
reported  to  carry  out  high  speed  matrix-matrix  and 
triple  matrix  multiplication  with  optics  [3-10], 

We  shall  however  describe  an  encoding  technique 
for  multiple  binary  number,  where  the  multiplica¬ 
tions  and  summations  of  digits  are  performed  in  par¬ 
allel.  Nevertheless,  we  shall  discuss  two  optical  ar¬ 
chitectures  for  multiple  matrix  m  iplication 
(MMM)  using  this  technique.  The  first  architecture 
employs  the  inner-product  method  to  carry  out  mul¬ 
tiple  matrix  multiplication.  Grating  masks  are  intro¬ 
duced  into  this  architecture  to  separate  the  output 
vectors,  so  that  a  fully  parallel  matrix  multiplication 
can  be  achieved.  The  second  architecture  combines 
the  inner-product  method  with  the  systolic  array  en¬ 
gagement  technique.  This  inner-product-systolic 
technique  is  capable  for  large  matrix  multiplication 
and  can  also  be  applied  to  linear  and  bilinear  trans¬ 
formations  (II).  Several  preliminary  experimental 
demonstrations  of  these  proposed  techniques  are 
provided. 


2.  System  description 

2. 1.  Multiple  binary  number  multiplication 

In  most  electronic  computers,  the  binary  number 
multiplication  is  performed  sequentially.  The  triple 
multiplication  of  binary  numbers  can  be  carried  out 
as  described  in  the  following. 

For  example,  given  three  binary  numbers  such  as. 
a=10l,  b-  1 10,  c  =  0l  1.  The  product  of  ah  can  be 
obtained  by  shifting  the  binary  digits  of  b  and  then 
multiply  by  each  bit  of  a.  as  shown  below 

1 10  XI 

1 10  x0 

+  110  xi 


1 1 1 10 

ab=axb  =  101  X  1 10=  1 1 1 10. 

Similarly  the  product  of  abc  can  be  obtained  by 
shifting  the  binary  digits  of  c,  and  then  multiply  by 
each  bit  of  ab,  as  shown  in  the  following 

01 1  X0 
011  XI 

Oil  Xl 

011  XI 

+  011  Xl 

101 1010 

abc=abxc  -11110x011  =  1011010. 
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Fit  I.  Optical  system  for  triple  binary  number  multiplication, 
<a)  basic  architecture,  (b)  optical  implementation. 


However,  the  triple  product  of  binary  numbers  can 
be  easily  performed  in  parallel  using  an  optical  tech¬ 
nique,  as  shown  in  fig.  I .  We  note  that  a  is  encoded 
onto  a  1-D  spatial  light  modulator  (SLM),  while  b 
and  c  are  encoded  onto  two  2-D  SLM's,  in  which  the 
binary  numbers  can  be  shifted  by  a  microcomputer. 
The  digit  1  and  0  can  be  represented  by  the  trans¬ 
parent  and  opaque  pixels  of  the  SLM.  The  three 
SLMs  are  located  at  planes  XI,  X2  and  X4,  and  the 
intermediate  product  ab  is  displayed  at  plane  X3. 
Thus  the  product  abc  can  be  obtained  at  the  plane 
X5.  To  avoid  the  carries,  the  products  ab  and  abc  are 
represented  by  mixed  binary  form.  Fig.  2  shows  a  hy¬ 
brid  optical  system  which  is  able  to  carry  out  this  op¬ 
eration.  Three  magneto-optic  spatial  light  modula¬ 
tors  (MOSLMs)  serve  as  inputs.  The  output  result 
is  detected  by  a  CCD  array  and  fed  back  to  a  high 
speed  memory.  A  microcomputer  is  used  as  a  date 
flow  controller.  In  the  system,  the  multiplications  can 
be  performed  by  the  binary  transmittances  of  the 
SLM’s,  and  the  sum  can  be  carried  out  by  simply  fo¬ 
cusing  the  light  onto  a  photo  detector.  An  incoherent 


Fif.  2.  A  hybrid  optical  system  for  optical  computin|. 


collimated  light  is  used  to  illuminate  SLM  I .  in  which 
the  cylindrical  lens  CL  I  w  ill  horizontally  expand  each 
bit  of  a  (SLM 1 1  onto  the  corresponding  row  of  b 
(SLM2).  Thus  the  logical  AND  operations  can  be 
taken  place  at  plane  X2.  Since  CL2  is  placed  behind 
CLI.  it  will  vertically  image  a  onto  the  correspond¬ 
ing  column  of  h(SLM2).  This  optical  arrangement 
will  increase  the  space-bandwidth-product  of  the 
processing  system.  Finally,  the  spherical  lens  SLI  will 
vertically  focus  the  light  onto  plane  X3,  to  perform 
the  summation.  Similarly,  a  cylindrical  lens  CL3  at 
X3  will  expand  each  bit  of  the  intermediate  product 
ab  onto  the  corresponding  column  of  c  (SLM3).  An 
unidirectional  dilTuser  is  suggested  to  be  placed  at 
the  focal  plane  of  SL2.  in  order  to  obtain  an  uniform 
illumination  of  sector  ( I'J  onto  SLM3  [2 ).  In  our 
experimental  setup,  instead  of  unidirectional  dif¬ 
fuser,  a  short  focal  length  cylindrical  lens  CL3  (/=  10 
mm)  is  placed  near  the  focal  plane  of  SLI,  and  SLM  3 
is  placed  far  enough  from  CL3  (about  250  mm),  then 
the  vertically  blurred  image  would  give  a  uniform  il¬ 
lumination  on  SLM3.  CL4  serves  the  same  purpose 
as  CL2.  Notice  again,  spherical  lens  SL2  will  per¬ 
form  the  vertical  summation  and  the  final  result  abc 
can  be  detected  by  a  CCD  detector  at  plane  X5. 

2.2  Multiple  matrix  multiplication  (MMM) 

We  shall  describe  an  architecture  for  vector-ma¬ 
trix-matrix  Multiplication.  For  simplicity,  we  con¬ 
sider  2x2  matrix  multiplication,  which  can  be  writ¬ 
ten  as 


l*n  *1:1 

,ru  **i: 

-ii  - 1 : 

1! 

*n  <  ::l 

=  [Mil  Mt:)  -ii  -i.' 


=  +1/  :r:, 

=  [k,,  t,:). 

where 

Ml  I  =  *M.»lt  +  . 

Mil  =.T|,l’i:+.T, ■ 
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(/,,  =  U,,Z,,  +  U,2Z2,  , 
+  «I2*23  , 


and 


1*21 

*22) 

.Fit 

Ft  2 

Z|| 

*12 

>21 

F22 

*2. 

Z22 

= 

l*2iy.! 

1  +  *2 

2>2I 

*21 

1-VlJ  +*22>'22  I 

*1.  *12! 

! 

*21  z22l 

= 

l«2l 

tf  22  1 

*11 

Z|2 

Z2I 

*22 

= 

{«2I*II 

•  +“22*21 

“21 

*12  + 

“22  *22  J 

= 

(V2I 

V22I  , 

(1) 

where 


«2l=*2l>'lt+*22y2.  . 

“22=Jf2l>'l2+->f22>'22. 

VU  =  U21ZM  +  W22Z21  . 

I;22=«2|T.2+M22222  • 

The  matrix  (A']  can  be  seen  as  composed  of  two  vec¬ 
tors  jc,=  [ jr, ,  xl2]  and  x2  =  [x2,  jr22].  An  optical  ar¬ 
chitecture  to  perform  this  task  is  shown  in  fig.  3.  No¬ 
tice  that  the  binary  form  of  vector  and  matrices  ( A  ] , 
[  K]  and  [Z]  can  be  encoded  onto  SLMI,  SLM2  and 
SLM3  with  a  microcomputer,  respectively.  The  spa¬ 
tial  encoding  form  of  each  element  is  described  in 
section  2. 1 .  The  microcomputer  will  sequentially  shift 
these  vectors  into  SLMI  which  is  located  at  plane 
XI.  Each  row  of  matrix  [  K)  is  multiplied  by  each 
corresponding  element  of  vector  (A).  A  vertical 
summation  is  carried  out  between  planes  X2  and  X3 
to  form  vector  (f/|  at  plane  X3.  The  same  proce¬ 
dures  are  repeated  between  planes  X3  and  X4,  X4 


KM  1  VH  1  j  CCD  OIWIK 


Fig.  3.  Architecture  for  multiple  matrix  multiplication. 


and  X5  to  obtain  [  U\  X  ( Z ).  At  the  output  plane,  a 
CCD  detector  will  sequentially  detect  each  corre¬ 
sponding  vector  of  the  output  matrix  |  f'j,  as  shown 
in  fig.  3. 

2.3.  Inner-product  architecture  using  grating  masks 

To  make  full  use  of  the  parallel  processing  capa¬ 
bility  of  the  optical  system,  an  architecture  to  per¬ 
form  MMM  in  parallel  is  proposed  in  the  following: 
In  figs.  4,  time  image  on  plane  X  3  can  be  considered 
as  one-dimensional  Fourier  transform  of  the  input 
signal  at  plane  XI,  by  neglecting  the  existence  of 
SLM2.  To  separate  the  two  vectors  (m,,  mi2J  and 
[u2,  u!2)  at  the  focal  plane  X3,  two  sinusoidal  grat¬ 
ings  with  different  spatial  frequencies  f,  and  f':  are 
inserted  immediately  behind  the  two  input  vectors 
|X|,x,2|  and  1*21*22)-  The  two  frequencies  are 
chosen  such  that  the  vectors  (m,,  i/i2|  and  [m:,  i/..| 
can  be  properly  separated  at  plane  X3.  In  a  similar 
manner,  two  sinusoidal  gratings  are  placed  behind 
the  two  vectors  (uM  u,2]  and  |u>,  tr,2]  respectively, 
at  plane  X3  Two  nonoverlapping  vectors  (t  M  t  ,.| 
and  [t’2,  t/j3 1  can  be  obtained  at  the  output  plane  X5. 

2.4.  Systolic-inner-product  architecture 

We  have  discussed  an  optical  system  for  parallel 
multiple  matrix  multiplication  using  the  inner-prod¬ 
uct  method  However,  this  technique  requites  large 
size  of  SLMs  to  carry  out  large  matrix  multiplica¬ 
tion.  We  shall  now  propose  a  hybrid  optical  system 
to  alleviate  this  shortcoming  Fig  5  shows  the  sys¬ 
tolic-inner-product  architecture  This  system  uses 
both  the  systolic  array  engagement  and  inner-prod¬ 
uct  technique,  the  matrix  multiplication  is  carried 
out  in  systolic  engagement  form,  in  which  the  prod- 

SIM  1  SIM  2  Oilllnjl  J»4  SIM  3  CCD  OflMlor 


Fig  4  Architecture  for  MMM  using  gt.nnng  masks 
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uct  of  elements  is  performed  in  inner-product  form 
depicted  in  sec.  2.1.  Since  the  hybrid  system  is  bas¬ 
ically  a  microcomputer-based  optical  processor,  the 
binary  number  matrix  representations  in  the  SLMs 
can  be  shifted  step-by-step  for  the  systolic  array  en¬ 
gagement.  Array  [X\  is  shifted  down  to  the  corre¬ 
sponding  columns  of  SLM l ,  arrays  ( T)  and  [Z]  are 
shifted  to  the  corresponding  rows  of  SLM2  and  SLM3 
respectively,  as  shown  in  fig.  6.  Notice  that  SLM3  is 
divided  into  two  parts:  upper  half  and  lower  half, 
which  are  further  segmented  into  a  4  x  2  array  cor¬ 
responding  to  the  [Z]  array.  A  wedge  is  placed  be¬ 
hind  the  lower  half  of  SLM3,  so  that  the  two  parts 
would  overlap  on  each  other  at  the  output  plane  X5. 


The  intermediate  results  obtained  at  the  output  plane 
in  each  step  are  integrated  by  a  CCD  detector  The 
output  matrix  [  F)  is  obtained  after  four  steps  of  time 
integration.  The  matrix  multiplication  can  be  per¬ 
formed  with  the  hybrid  processor  shown  in  fig  2 
There  is  however  a  price  we  paid  for  using  this  tech¬ 
nique,  namely  the  speed.  For  example  a  2  x  2  matrix 
multiplication  requires  a  four-step  operation.  Never¬ 
theless,  the  required  size  of  the  SLMs  used  in  the 
processor  can  be  substantially  smaller  by  decompos¬ 
ing  the  matrices  and  then  applying  the  systolic-inner- 
product  method. 

3.  Experimental  demonstration 

Several  experimental  demonstrations  have  been 
carried  out  with  the  proposed  hybrid  optical  archi¬ 
tectures  for  multiple  matrix  multiplication.  We  have 
first  use  a  triple  binary  number  multiplication  for  the 
experiment,  as  illustrated  in  figs.  I  and  7.  To  avoid 
the  coherent  artifact  noise,  a  white  light  source  is  used 
to  carry  out  the  processing.  The  focal  length  of  the 
cylindrical  and  spherical  lenses  are  10  mm  and  100 
mm,  respectively.  To  show  the  feasibility  operation 
of  the  proposed  technique,  binary  coded  transparent 
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masks,  instead  of  SLMs,  are  used  in  our  experiments. 

Fig.  7(a)  shows  the  binary  mask  representation  of 
a=101,6=110  and  c = 0 1 1 ,  respectively.  The  output 
result  is  shown  in  fig.  7(b).  Fig.  7(c)  shows  the  out¬ 
put  photometer  trace,  which  corresponds  to  the 
mixed  binary  number  representation  of 
abc= 0122210.  By  proper  thresholding  of  the  output 
signal,  the  result  can  be  converted  into  binary  form, 
which  is  abc=  101 1010,  as  shown  in  fig.  7(d). 

For  another  experimental  demonstration,  we  show 
that  triple  matrix  multiplication  can  be  obtained  with 
a  hybrid  optical  architecture  of  fig.  3.  The  binary 
representation  of  the  encoded  masks  are  shown  in 
fig.  8(a),  which  represents  the  matrices  in  the 
following, 


m= 


00100  01000 
00010  00011 


m  = 


00100 

00011 


00001 

00010 


[Z]  = 


10000  00010 
01000  00110 


Again  fig.  8(b)  shows  the  output  intensity  distri¬ 
bution,  and  fig.  8(c)  shows  the  mixed  binary  form 
of  the  output  matrix  [  F],  i.e.. 


[V]  = 


V,2 

Vn 


000 1121001100  0001331011000 
00000 10132000  0000 101102000 


fig  7  (a)  Three  masks  for  triple  binary  number  multiplication,  (b)  Output  signals  detected  on  plane  X5  (c)  Result  displayed  on  an 
oscilloscope  in  mixed  binary  form,  (d)  Final  result  in  binary  form. 
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parallelism  for  more  flexibility.  The  bottleneck  of  the 
proposed  hybrid  optical  processor  is  the  input  and 
output  interfacing  between  electronic  and  photonic 
signals.  The  electronically  addressed  SLMs  and  light 
detection  device  limited  the  overall  processing  speed 
of  the  hybrid  optical  system.  However,  due  to  the 
rapid  development  in  the  areas  of  optical  storage  and 
optical  logic  material,  it  is  expected  that  the  bottle¬ 
neck  problem  would  be  alleviated  by  using  the  high 
speed  optical  memory  and  optical  parallel  logic  ele¬ 
ments.  A  high  speed  process  would  be  achieved  by 
the  data  flow  in  the  parallel  optical  processor. 

S.  Conclusion 

We  have  presented  a  technique  that  multiple  bi¬ 
nary  number  multiplication  can  be  parallelly  per¬ 
formed  by  a  microcomputer-based  optical  processor. 
Two  basic  architectures  to  perform  multiple  matrix 
multiplication  are  discussed.  In  the  first  architec¬ 
ture,  ve  used  an  inner-product  technique,  such  that 
mul>  pie  matrix  multiplication  can  be  simultane¬ 
ously  carried  out.  For  the  other  architecture,  we  used 
a  s:  .tolic-inner-product  technique  to  carry  out  the 
multiple  matrix  multiplication.  Although,  in  prin¬ 
ciple.  the  inner-product  technique  offers  a  higher 
speed  operation,  however,  it  requires  larger  SLMs  to 
carr,  out  the  process.  Since  both  techniques  use  either 
mixed  binary  or  binary  representation,  the  system 


would  offer  high  accuracy  with  moderate  speed  mul¬ 
tiple  matrix  multiplication. 
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An  investigation  of  using  phase  conjugate  techniques  to  remove  phase  distortion  in  a  joint  transform  correlator  (JTC)  is  pre¬ 
sented.  For  improving  the  accuracy  of  detection,  a  phase  encoding  method  based  on  the  nonlinearity  of  phase  conjugation  is  also 
proposed.  Experimental  results  and  computer  simulations  are  provided. 


I.  Introduction 

Recently,  advances  in  photorefractive  materials 
have  stimulated  interest  in  the  application  of  phase 
conjugation  techniques  to  a  number  of  signal  pro¬ 
cessing  problems  [  1  ] .  Presently,  the  phase  conju¬ 
gation  mirror,  based  on  the  self  pumped  configura¬ 
tion  [2]  in  photorefractive  crystals,  exhibits 
reflectivities  as  high  as  70%,  while  requiring  only  a 
few  tens  of  milliwatts  of  optical  input  power.  Thus, 
this  greatly  extends  the  range  of  practical  applica¬ 
tions  of  phase  conjugation  mirrors.  In  this  paper  we 
will  explore  its  application  to  a  joint  transform  cor¬ 
relator  (JTC).  The  JTC  [3,4]  is  a  powerful  image 
processor,  particularly  for  pattern  recognition  appli¬ 
cation,  since  it  avoids  the  synthesis  and  alignment 
problems  of  a  matched  spatial  filter.  In  most  coher¬ 
ent  image  processing  applications,  the  input  objects 
are  required  to  be  free  from  any  phase  distortion.  The 
input  objects  of  a  real  time  optical  processor  are  usu¬ 
ally  generated  by  means  of  a  spatial  light  modulator 
(SLM),  however,  most  SLMs  introduce  some  sort  of 
phase  distortion.  We  note  that  phase  distortion  can 
severely  degrade  the  correlation  characteristics  in  a 
JTC.  Although  liquid  gates  may  be  used  to  compen¬ 
sate  the  phase  distortion  to  some  extent,  they  can  only 
remove  the  external  distortion  but  generally  can  not 
compensate  the  internal  distortion  of  the  devices. 
Furthermore,  holographic  optical  elements  (HOE) 
may  provide  another  means  of  phase  distortion  re¬ 
moval  [5],  but  they  have  the  disadvantages  of  crit¬ 
ical  alignment  and  cumbersome  fabrication. 


Another  problem  common  to  the  JTC,  as  well  as 
other  coherent  correlators,  is  that  the  width  of  the 
correlation  spot  is  too  broad,  and  the  cross  correla¬ 
tion  intensity  is  too  high.  To  improve  the  accuracy 
of  correlation  detection,  the  object  functions  can  be 
pre-encoded.  The  inherent  nonlinearities  in  phase 
conjugation  may  be  used  for  this  encoding  process. 
Let  us  now  consider  a  four-wave  mixing  JTC,  as 
shown  in  fig.  I.  We  propose  the  object  beam  of  the 
four-wave  mixing  is  applied  to  the  input  of  a  JTC. 
Notice  that  this  configuration  would  have  two  major 
advantages. 

1.  The  phase  distortion  due  to  the  input  SLM  can 
be  automatically  compensated  by  the  conjugated 
wavefront. 

2.  An  additional  amplitude  or  phase  modulation, 
produced  by  the  nonlinearity  of  phase  conjugation. 


Fig.  I.  Experimental  setup.  BS.  Beam  splitter;  M.  mirror,  O.  ob¬ 
ject;  Q,  quarter  wave  plate;  A.  analyzer;  L,.  imaging  lens:  L;, 
Fourier  transform  lens:  Po.  output  plane 
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may  provide  a  means  of  improving  the  accuracy  of 
correlation  detection. 


2.  Principle 

It  is  well  known  that  phase  conjugation  can  be  pro¬ 
duced  with  a  photo-refractive  crystal.  With  referring 
to  the  JTC  in  fig.  I,  the  readout  beam  is  adjusted  be¬ 
yond  the  coherent  length  with  respect  to  the  writing 
beams.  In  other  words,  the  setup  represents  a  two- 
wave  mixing  configuration  with  a  real-time  readout 
beam.  Notice  that  the  expanded  collimated  Ar*  laser 
beam  (2=0.5145  pm)  is  divided  into  three  paths. 
One  is  directed  toward  the  photo-refractive  crystal 
(BSO,  lOx  10x2  mm’)  by  mirror  M2  and  serves  as 
the  reference  beam.  The  second  is  used  to  illumi¬ 
nated  the  input  objects  O,  and  02,  which  are  imaged 
onto  the  crystal  by  lens  L,.  The  third  is  directed  by 
mirror  Ml,  M5,  M4  and  serves  as  the  readout  beam. 
The  reconstructed  beam  from  the  crystal  is  then  im¬ 
aged  back  to  the  input  objects  O,  and  02  for  phase 
distortion  removal.  After  passing  through  the  input 
objects,  the  beam  is  then  joint  transformed  in  the 
output  plane  P0  by  lens  L2,  via  a  beam  splitter  BS,. 
We  notice  that  a  half  wave  plate  Q,  between  the  BSO 
crystal  and  mirror  M4,  is  used  to  rotate  the  polari¬ 
zation  of  the  readout  beam.  An  analyzer  A  located 
at  the  front  of  the  output  plane  is  used  to  reduce  the 
light  scattered  from  the  optical  elements  in  the 
system. 

With  reference  to  the  optical  configuration  of  fig. 
1,  the  object  beam  can  be  written  as 

0(x,y)  exp[i0(x,  y)J 

=  0,{x-b,y)  exp{i0,  (x-6,  y)  | 

=  02(x+fc,y)  exp[i02(x  +  b,y)]  ,  (1) 

where  O,,  02,  0i  and  fa  are  the  amplitude  and  phase 
distortion  of  the  input  objects,  respectively,  b  is  the 
mean  separation  of  the  two  input  objects,  and  O,,  02 
»re  assumed  positive  real.  At  the  image  plane  (i.e. 
the  crystal),  the  object  beam  is  given  by 

0{x/M,y/M )  exp(id(x/A/,y/A/)| 

Xexp(ifr(x,  +  y,)/2L j  ,  (2) 

where  M  represents  the  magnification  factor  of  the 


imaging  system,  L=s—f  s  is  the  image  distance,  I  is 
the  focal  length  of  lens  L,,  k  =  2n/X,  2  is  the  wave¬ 
length  of  the  light  source. 

Thus,  the  reconstructed  beam  emerging  from  the 
crystal  is  given  by 

O'  ( x/M ,  y/M)  exp[  y/M) ) 

X  exp(  -  ik(xi+y1)/2L]exp[i0(x/M,  y/M)  J. 

(3) 

Notice  that  expression  ( 3 )  does  not  represent  the  ex¬ 
act  phase  conjugation  of  expression  (2).  The  am¬ 
plitude  distribution  of  O’  (x.  y)  deviates  somewhat 
from  0(x,  y),  which  is  primarily  due  to  the  nonlin¬ 
earity  of  the  BSO  crystal  [6  ].  A  phase  shift  0(x,  y) 
between  the  phase  conjugation  and  the  recon¬ 
structed  beam  is  also  introduced.  Later  we  will  see 
that  0(x,  y)  is  dependent  on  the  intensity  ratio  R  of 
the  object  beam  and  the  reference  beam.  If  there  is 
no  voltage  applied  on  the  BSO  crystal,  6(x,y)  would 
represent  a  constant  phase  of  90°. 

As  can  be  seen  in  fig.  1,  the  reconstructed  beam, 
imaged  back  on  the  object  plane,  can  be  written  as 

0'[x,y)  exp[  —  i0(x,  y ) )  exp(ifl(x,  y) )  (4) 

After  passing  through  the  input  objects,  the  complex 
light  distribution  becomes 

0(x, y)  O'  (x, y)  exp[i0(x, y)  ]  (5) 

This  expression  shows  that  the  phase  distortion  0(  r, 
y)  of  the  input  objects  can  essentially  be  removed, 
while  the  additional  amplitude  and  phase  modula¬ 
tion  due  to  the  nonlinearity  of  the  BSO  remain 

3.  Phase  distortion  compensation 

The  phase  distortion  of  the  input  objects  (i.e.  due 
to  the  SLM )  can  severely  degrade  the  correlation 
characteristics.  We  have  computer  simulated  some 
of  these  effects.  The  simulations  were  obtained  with 
a  test  input  pattern  joint  correlated  with  the  same 
pattern  added  with  random  phase  noise.  We  as¬ 
sumed  that  the  random  phase  noise  has  a  uniform 
probability  distribution  over  a  phase  interval  [  -a. 
a)  Fig.  2  shows  a  plot  of  correlation  peak  intensity 
as  a  function  of  phase  deviation  a  From  this  graph, 
we  see  that  the  normalized  peak  drop  of  0.5  corrc- 


72 


Volume  71,  number  3,4 


OPTICS  COMMUNICATIONS 


15  May  1989 


Correlation  peak  value 


Maximum  phase  deviation  (radians) 


Fig.  2.  Correlation  peak  intensity  degraded  by  phase  noise. 

KK 

a 


b  c 


Fig.  3.  Joint  Fourier  transform  spectra,  (a )  A  pair  of  input  sub¬ 
jects  with  random  noise,  (b)  Their  joint  transform  spectrum,  (c) 
The  joint  transform  spectrum  with  phase  compensation. 

sponds  to  a  phase  deviation  of  0.6  radians.  In  other 
words,  the  phase  distortion  of  a  SLM  should  not  ex¬ 
ceed  1/10  wavelength,  which  corresponds  to  0.6  ra¬ 
dians,  otherwise  the  correlation  peak  would  be  se¬ 
verely  degraded.  However,  most  SLMs  do  not  meet 
this  requirement. 

In  order  to  demonstrate  the  phase  compensation 
with  phase  conjugate  technique,  a  pair  of  input  ob¬ 
jects,  shown  in  fig.  3a,  is  added  with  a  random  phase 
plate.  Their  joint  transform  spectrum  is  shown  in  fig. 
3b.  Notice  that  the  spectrum  is  severely  corrupted  by 
the  phase  disturbances.  However,  with  the  phase 
compensation  technique,  the  spectrum,  obtained  with 
the  experimental  setup  described  in  fig.  I,  is  rela¬ 
tively  free  from  the  disturbance  as  shown  in  fig.  3c. 


Fig.  4  shows  the  correlation  spots  reconstructed  from 
these  two  cases.  For  no  phase  compensation,  the  cor¬ 
relation  spots  are  heavily  embedded  in  random  noise, 
as  pictured  in  fig.  4a.  while  with  phase  compensa¬ 
tion,  the  correlation  spots  can  clearly  be  seen  in  fig. 
4b. 

It  is,  however,  necessary  to  stress  the  role  played 
by  the  imaging  lens  L,.  First,  lens  L,  ensures  that  all 
the  light  scattered  by  the  input  objects  can  be  di¬ 
rected  toward  the  BSO  crystal  (assume  that  L,  has 
a  sufficiently  large  aperture.).  Secondly,  the  recon¬ 
structed  beam  is  not  the  exact  phase  conjugated 
beam,  it  has  an  additional  phase  modulation  9(x,  y). 
Thus,  it  is  apparent  that  if  no  imaging  lens  is  em¬ 
ployed,  the  light  ray  emerging  from  an  arbitrary  ob¬ 
ject  point  would  not  longer  be  reconstructed  back  at 
the  same  point.  By  using  the  imaging  lens,  it  ensures 
that  every  light  ray  emerging  from  the  objects  would 
be  reconstructed  back.  As  long  as  all  the  light  scat- 


Fig.  4.  Reconstructed  correlation  spots.  ( a )  Without  phase  com¬ 
pensation.  (b)  With  phase  compensation. 
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tered  by  the  phase  distortion  of  the  objects  are  col¬ 
lected  by  the  aperture  of  L,t  the  phase  distortion  of 
the  objects  can  be  compensated  by  this  technique. 
However,  if  the  aperture  is  not  large  enough,  the  high 
spatial  frequency  components  of  the  phase  distor¬ 
tion  could  not  be  compensated. 


4.  Pre-encoding 


The  reconstructed  beam,  as  expressed  in  eq.  (5), 
is  different  from  the  object  function  0(x,  y).  The 
additional  amplitude  and  phase  factors  within  the 
reconstructed  beam  can  be  used  for  obj  ct  pre-en¬ 
coding  in  a  JTC,  for  which  the  correlation  charac¬ 
teristics  can  be  improved.  These  factors  are  depen¬ 
dent  on  object  and  reference  beam  ratio  R  [6],  as 
defined  by 


R(x,y)  = 


Q2{x/M,y/M) 

I. 


(6) 


where  I,  is  the  intensity  of  the  reference  beam. 

The  phase  modulation  0(x,  y)  represents  the  phase 
difference  between  the  conjugation  of  the  object  beam 
and  the  actual  reconstruction  beam  (see  expression 
(3) ).  This  phenomenon  is  due  to  the  interaction  be¬ 
tween  the  writing  beams  [7],  According  to  Vahey 
[8],  the  phase  deviation  between  the  writing  beams 
varies  along  the  propagation  within  the  crystal  and 
can  be  expressed  as 


where 


Q(z)=2/zsin(0,) 

+  tan-'[(l— *)/<!+*>) ,  (8) 

r  is  the  coupling  constant,  <t>,  is  the  phase  shift  be¬ 
tween  the  writing  interference  pattern  and  the  in¬ 
duced  index  grating,  and  y/(0)  is  the  initial  phase  de¬ 
viation  between  the  writing  beams.  This  phase 
variation  would  produce  grating  bending  within  the 
crystal.  When  a  readout  beam  illuminates  the  crys¬ 
tal,  the  reconstructed  wavefront  from  the  bended 
volume  grating  would  have  a  phase  shift  6( x,  y)  rel¬ 
ative  to  the  conjugate  wavefront  of  the  object  beam. 
Fromeqs.  (7),  (8)and  (6),  we  notice  that  this  phase 


shift  9(. r,  y)  is  dependent  on  R  and  directly  related 
to  the  object  intensity  distribution  0(x,  y).  There¬ 
fore  the  phase  modulation  0(x,  y)  can  be  utilized  to 
encode  the  object  functions. 

We  have  computer  simulated  the  effects  of  pre-en¬ 
coding  the  object  functions  in  a  JTC.  Fig.  5  is  the 
intensity  distributions  of  two  objects  to  be  corre¬ 
lated.  The  autocorrelation  curve  ( for  the  triangle  ob¬ 
ject)  and  their  cross  correlation  curve  are  shown  in 
figs.  6(a)  and  (b),  respectively.  We  notice  that  the 
wide  autocorrelation  curve  and  high  cross  correla¬ 
tion  intensity  are  not  desirable.  However,  if  a  phase 
encoding  (assumed  linear,  that  is  0( x,  y)xO(x,  y) ) 
is  added  to  the  objects  the  correlation  characteristics 
are  improved  substantially,  as  shown  in  fig.  7,  where 
the  maximum  encoded  phase  0mn  is  8  radians.  By 
comparing  fig.  6  with  fig  7,  we  notice  that  the  width 
of  the  autocorrelation  reduces  and  the  cross  corre¬ 
lation  intensity  decreases.  Furthermore,  fig.  8  illus¬ 
trates  how  the  autocorrelation  width  decreases 
monotonically  as  the  increase  of  the  linear  phase 
encoding. 

In  view  of  expression  ( 5 ),  object  encoding  can  also 
be  accomplished  with  amplitude  modulation.  It  is 
obvious  that  O’  (x,  y)  is  proportional  to  the  diffrac- 


Fig.  5.  intensity  distributions  of  the  object  to  be  correlated 


Correlation 


Fig-  6  Correlation  without  phase  encoding  (a|  Autocorrelation 
(b)  Cross  correlation. 
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Correlation 


Fig.  7.  Correlation  with  phase  encoding,  normalized  by  the  cross, 
correlation  peak  intensity  in  fig.  6.  The  maximum  encoded  phase 
6m,  is  8  radians,  (a)  Autocorrelation,  (b)  Cross  correlation. 

Correlation  Width 


Fig.  8.  Autocorrelation  width  ( 50%  down  width )  decreases  with 
the  increase  of  linear  phase  encoding.  X  axis  represents  the  max¬ 
imum  encoded  phase  8W. 


lion  efficiency  r\  of  the  phase  grating  within  the  crys¬ 
tal.  With  reference  to  Ochoa  et  al.  {6),  the  diffrac¬ 
tion  efficiency  r\  of  the  phase  grating  in  a  photo- 
refractive  material  is  related  to  the  intensity  ratio  R 
of  two  writing  beams  as 

q(x ,y)ocR,  R<  1.  ,o'( 

oc  1  /r,  R>  l 

Thus,  different  amplitude  encoding  may  be  accom¬ 


plished  by  controlling  the  intensity  of  the  reference 
beam,  for  example,  edge  enhancement,  which  is  a 
desirable  pre-processing  in  a  JTC  (9).  Some  discus¬ 
sion  for  amplitude  encoding  may  be  found  in  ref.  [6], 

5.  Conclusion 

Several  applications  of  phase  conjugation  tech¬ 
nique  in  a  JTC  have  been  investigated.  It  is  shown 
that  phase  distortion  in  the  input  objects  (due  to 
SLM)  in  a  coherent  image  processing  system  can  be 
efficiently  compensated  by  using  phase  conjugation 
technique.  The  additional  amplitude  or  phase  mod¬ 
ulations  produced  by  the  nonlinearity  of  phase  con¬ 
jugation  can  be  utilized  to  pre-encode  the  object 
functions,  for  which  correlation  characteristics  can 
be  improved.  Computer  simulations  indicate  that 
phase  pre-encoded  objects  improve  the  accuracy  of 
correlation  detection,  which  is  resulted  from  smaller 
autocorrelation  spots  and  lower  cross  correlation  in¬ 
tensity.  This  encoding  technique  would  find  appli¬ 
cation  to  the  research  of  dynamic  pattern  recogni¬ 
tion  and  robotic  vision. 
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We  present  a  novel  method  for  obtaining  the  phase  distribution  of  an  object  spectrum  by  using  a  fringe-scanning 
phase-conjugate  interferometer.  A  detailed  analysis  of  the  proposed  technique  is  provided,  and  eiperimental 
demonstrations  for  validating  this  technique  are  also  given.  The  major  advantages  of  this  method  are  its  potential¬ 
ly  high  accuracy  and  its  low  space-bandwidth-product  requirement  for  the  detection  system. 


Any  object  function  0(x,  y)  can  be  represented  in  the 
Fourier  frequency  domain  aa  1 0(u,  t>)|exp[/>(u,  u)j, 
where  (u,  v)  is  the  spatial-frequency  coordinate  sys¬ 
tem.  However,  in  many  applications  the  phase  distri¬ 
bution  <p(u,  v )  is  more  important  than  the  amplitude 
information  1 0{u,  u)|.  To  measure  the  phase  distribu¬ 
tion  of  an  object  spectrum,  an  interferometric  method 
that  uses  a  reference  beam  may  be  used.  There  are 
two  general  types  of  reference  beam  that  can  be  em¬ 
ployed  for  this  purpose:  ( 1 )  a  reference  beam  ha ving  a 
uniform  amplitude  and  phase  distribution  (e.g.,  an 
oblique  plane  wave)  and  (2)  a  phase-conjugated  object 
spectrum.  Thus,  in  the  first  case,  a  problem  of  fringe 
contrast  variation  exists  because  of  the  nonuniform 
object  spectrum.  On  the  other  hand,  by  using  a 
phase-conjugate  spectrum  as  the  reference,  uniform 
contrast  fringes  can  be  obtained.  However,  since  the 
measured  phase  is  2 0(u,  v),  a  r  phase  ambiguity  prob¬ 
lem  exists. 

In  a  recent  paper1  Xu  proposed  a  joint  transform 
configuration  that  uses  a  conjugate  reference  beam  for 
the  phase  measurement,  in  which  the  intensity  of  the 
real  part  and  the  imaginary  part  of  the  object  spec¬ 
trum  can  be  obtained.  The  method  has  some  draw¬ 
backs.  First,  his  technique  introduces  a  carrier  fre¬ 
quency  that  requires  a  higher  space-bandwidth-prod- 
uct  detection  system.  Second,  the  signs  of  the  real 
and  the  imaginary  parts  of  the  object  spectrum  cannot 
be  uniquely  determined,  resulting  in  four  ambiguous 
phase  values.  Third,  the  phase  measurement  is  de¬ 
rived  primarily  from  two  intensity  distributions  and  is 
vulnerable  to  system  noise. 

In  this  Letter  we  describe  a  technique  that  uses  a 
fringe-scanning  phase-conjugate  interferometer2 
(PCI)  for  the  phase  measurement  of  the  object  spec¬ 
trum.  One  of  the  advantages  of  using  a  PCI  is  the 
elimination  of  carrier  frequency,  for  which  a  low 
ipace-bandwidth  detection  system  can  be  used.  With 
(  PCI  the  output  interferometric  pattern  is  not  affect¬ 
ed  by  the  variations  of  the  optical  path  difference. 
Therefore  it  is  not  sensitive  to  turbulence  and  is  capa¬ 


ble  of  self-aligning.  To  improve  the  accuracy  of  the 
measurement,  a  fringe-scanning  method  is  introduced 
into  the  system.  In  a  PCI,  however,  fringe  scanning 
cannot  be  achieved  by  changing  the  optical  path  dif¬ 
ference,  as  in  conventional  fringe-scanning  tech¬ 
niques.  In  a  recent  paper  Wu  et  al*  suggested  a  polar¬ 
ization-encoding  method  that  we  will  apply  for  fringe 
scanning  in  the  PCI. 

Figure  1  shows  the  proposed  experimental  setup. 
The  light  source  is  a  45°  linearly  polarized  collimated 
Ar*  laser  beam  (X  *  488  nm).  A  Bi^SOso  (BSO) 
crystal  is  used  as  the  phase-conjugate  mirror.  Two 
pumping  beams  are  derived  from  beam  splitters  BSi 
and  BS2,  respectively,  and  then  directed  toward  the 
BSO  crystal  at  opposite  directions  with  mirrors  Mt- 


Fig.  1.  Experimental  setup  for  phase  measurement.  M’s, 
mirrors;  BS's,  beam  splitters;  PBS,  polarizing  beam  splitter; 
L’s,  lenses;  Q,  quarter-wave  plate;  A,  analyzer;  MS,  micro¬ 
scope;  CCD,  charge-coupled  device  camera. 
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Fig.  2.  Orientation  of  polarizing  components:  Pi,  P//,  S 
and  P  polarization,  respectively;  Q„  Qf,  slow  and  fast  axes, 
respectively,  of  the  quarter-wave  plate;  A,  analyzer. 


M3.  The  beam  reflected  by  is  split  by  the  polariz¬ 
ing  beam  splitter  PBS.  The  resulting  beams  illumi¬ 
nate  the  object  transparencies  0(x,  y)  and  0(-x,  -y) 
and  are  directed  toward  the  BSO  crystal  by  mirrors  Ms 
and  Mg,  respectively.  Thus  two  phase-conjugate 
beams  emerge  from  the  BSO  crystal,  retracing  the 
input  paths  to  be  combined  by  the  polarizing  beam 
splitter  as  the  output  of  the  PCI.  In  the  PCI  all  phase 
distortions  are  automatically  compensated  for.  No¬ 
tice  that  an  object  transparency  0(x,  y)  is  placed  in 
one  arm  of  the  interferometer,  and  its  antisymmetric 
copy  0(— x,  — y)  is  placed  in  the  other  arm.  [A  change 
of  relative  position  between  0(x,  y)  and  0(— x,  -y)  in 
the  PCI  would  only  introduce  a  linear  phase  factor  to 
the  object  spectrum  and  is  equivalent  to  a  change  of 
the  object  origin.]  Thus  the  corresponding  object 
spectra  0(a,  v)  and  0*(u,  v )  are  present  at  the  back 
focal  plane  of  lens  L3. 

With  reference  to  the  PBS,  two  output  phase-conju¬ 
gated  beams,  in  the  two  arms  of  the  interferometer,  are 
orthogonally  linearly  polarized.  The  corresponding 
output  spectra  can  be  expressed  in  a  Jones  vector  as 

f  0(x,y)  ]^r|0(utu)|expl/'<*>(u1u)]  1 

[0(-x,  — y) J  o)|exp[-;'0(u,  u)]J 


The  quarter-wave  plate  Q  in  Fig.  I  is  at  a  45°  (angle) 
orientation,  as  shown  in  Fig.  2.  The  Jones  vector 
behind  the  quarter-wave  plate  Q  can  then  be  written 

as 


■  2l0(u,  o)lexp  ^ j  ^ 


COS 

<Mu,  u)  +  ^ 

sin 

4>(u,  0)  +  7 

1 

L  4J 

. 

(2) 


The  corresponding  intensity  distribution  at  the  back 
focal  plane  of  Ls,  behind  the  analyzer,  can  be  ex¬ 
pressed  as 

I(u,  v,  9)  ■  2l(3(u,  u)|2|l  -  sin(20(u,  v )  -  29]|,  (3) 


which  represents  an  interferometric  pattern,  where  9 
is  the  orientation  angle  of  the  analyzer  (see  Fig.  2). 
From  this  result,  we  see  that  an  additional  phase  con¬ 
stant  (i.e.,  29)  is  introduced.  It  is  apparent  that,  by 
rotating  the  analyzer,  fringe  scanning  of  the  interfero¬ 
metric  pattern  can  be  obtained. 

By  referring  to  the  conventional  fringe-scanning 
techniques,4  one  may  derive  the  phase  distribution 
from  the  intensity  variation  with  9,  /(u,  u,  9): 


2<t>(u,  v)  =  tan  1  \  (4) 

[A(u,  v) J 

where 

A(u,  0)  =  n?r|0(u,  u)|2  cos|2<£(u,  u)j 

l(u,  v,  0)sin  20d9, 

Jo 

B(u,  v)  =  mr|0(u,  i>)|2  sin[2$(u,  u)] 

tnw 

-  Hu,  u,  9)cos  26  J9,  (5) 

Jo 

and  n  is  an  integer.  In  practical  measurements,  in¬ 
stead  of  performing  the  continuous  integration,  one 
uses  discrete  summations.  This  can  be  expressed  as 


Fig.  3.  Output  fringe  shift  with  respect  to  the  analyzer 
orientation  angle. 
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Fig.  4.  Implementation  of  an  electro-optic  birefringence 
modulator  (E-0  BM).  Other  abbreviatione  aa  in  Fig.  1. 


m 

A(uf  v )  -  V  I(u,  v,  O^sin  29j, 
i-l 


B{u,  v)  -  ^  I(u,  v,  0,)cos  20j,  (6) 

i-i 


where  9,  =■  ir/m  and  m  is  the  number  of  summation 
steps.  The  fringe-scanning  technique  reduces  four 
ambiguous  phase  values  to  two. 

In  order  to  demonstrate  the  principle  of  the  pro¬ 
posed  technique,  a  rectangular  aperture  with  a  small 
displacement  from  the  optical  axis  in  the  horizontal 
direction  (i.e.,  0(x,  y)j  is  used  as  the  object.  Its  anti¬ 
symmetric  copy,  0(-x,  - y ),  is  in  fact  the  same  aper¬ 
ture  but  with  the  displacement  in  the  opposite  direc¬ 
tion  from  the  optical  axis.  Figure  3  shows  the  output 
interferometric  patterns  obtained  with  this  proposed 
PCI,  with  different  angular  orientations  of  the  analyz¬ 
er.  Because  the  diffraction  efficiency  of  our  phase- 
conjugate  mirror  is  low,  the  sideiobes  of  the  object 
spectrum  cannot  be  seen  clearly  in  the  pictures.  We 
noted  that  the  interferometric  fringes  are  linearly 
shifted  with  the  changing  of  9.  This  indicates  that 
the  phase  of  the  object  spectrum  is  a  linear  distribu¬ 
tion.  The  period  of  the  fringe  shifting  with  9  is  180°. 

One  of  the  striking  features  of  the  fringe-scannin. 
technique  in  the  PCI  is  its  invulnerability  to  noise. 
Let  us  now  look  at  the  standard  deviation  of  the  phase 
error  due  to  noise,  as  given  by* 


(7) 


where  s/n  is  the  output  intensity  signal-to-noise  ratio. 
From  this  equation  we  see  that  phase  error  de¬ 
creases  as  the  summation  steps  increase. 

To  increase  the  measurement  speed,  an  electro-op¬ 
tic  birefringence  modulator  can  be  used  between  the 
PBS  and  the  transform  lens  L3,  as  illustrated  in  Fig.  4. 


Instead  of  rotating  the  analyzer,  one  can  dramatics 
increase  the  measured  speed  using  an  electro-opti 
modulator.  We  now  assume  that  the  electro-op* 
modulator  introduces  a  birefringence  phase  shift  or. 
The  right-hand  side  of  Eq.  (1)  can  now  be  written  as 

|0(u,  i>)|expl/Xu,  u)) 

|(5(u,  o)|exp|-;>[(u,  0)  +  aj| 

Thus  Eq.  (3)  becomes 

/(it,  u,  9,  a)  =  2\0(u,  u)|J|l  -  sin(2i£(u,  0)  —  29  -  a]|. 

(9) 

From  this  equation  we  see  that,  by  simply  changing 
the  modulation  angle  a,  we  can  accomplish  rapid 
fringe  scanning. 

It  is  well  known  that  ail  fringe-scanning  techniques 
require  certain  computations  From  Eqs.  (6),  the 
number  of  multiplications  required  is  2mn2,  where  n2 
is  the  number  of  sampling  points  over  the  spectrum 
plane.  If  a  digital  fast-Fourier-transfnrm  algorithm 
were  used,  the  required  number  of  multiplications  for 
n  X  n  input  data  would  be  of  the  order  of  4 n2  log2  n. 
This  does  not,  however,  appear  to  be  significantly  dif¬ 
ferent  from  the  number  of  multiplications  2mn2.  In 
the  fringe-scanning  method  the  factors  to  he  multi¬ 
plied  are  fixed  to  only  a  few  values.  Instead  of  per¬ 
forming  real-time  multiplications,  one  can  use  a  data 
look-up  table  to  speed  up  the  computational  process. 
Moreover,  the  spectral  content  of  the  object  in  the 
Fourier  plane  is  concentrated  mostly  in  some  specific 
regions.  It  is  generally  not  necessary  to  compute  the 
phase  distribution  over  the  entire  n  X  n  points.  In 
other  words,  the  computation  cnn  be  selected  based  on 
the  spectral  intensity  distribution;  thus  the  amount  of 
computational  time  can  be  substantially  reduced. 

We  acknowledge  the  support  of  the  U  S.  Air  Force 
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ABSTRACT 

An  adaptive  h\hrtj  opiual  rental  net*  ml  mint  a  lu%h  rcivluttm  video 
monitor  as  a  programmable  (»m».  mtn  r  nuovn  n  pmpnud  7/m  onht- 
tecture  is  capable  of  implementing  farmer  number %  of  nrurotw  mth  lusher 
dynamic  range  The  proposed  ji  item  tan  hr  ••pirtind  "i  a  hit»h  \pccd 
asynchronous  mode  wfrtt  parallel  ft  edluuk  h'>p  I  hr  orth-  gomil  ptojet- 
tion  algorithm  as  applied  (o  the  proposed  mmn  10  imrnnp  r/jp  error 
correction  ability  is  given. 

I.  INTRODUCTION 

In  recent  year?  attention  has  been  drawn  tn  (lie  problems 
concerning  optical  implementation  id  neural  networks  Re 
cently,  a  two  dimensional  (2  D)  optital  neural  network  lias 
been  synthesized  by  Partial  and  I’saltis.  Tor  which  they  used 
the  basic  concept  of  vector-matrix  optical  processing  [1|  this 
optical  neural  network  is  composed  of  a  linear  array  of  I.PDs 
as  an  input  device,  which  is  interconnected  to  a  weighting 
mask  by  a  lenslet  array  To  provide  the  network  with  sclf- 
organizaiion  and  learning  capabilities,  a  programmable  spatial 
light  modulator  (SIM)  with  line  resolution  and  a  large  num¬ 
ber  of  distinguishable  grav  levels  is  needed  as  an  interconnec¬ 
tion  weight  matrix  ||WM)  However,  cnrmillv  available  SIMs 
have  small  space- bandwidth  products  and  limited  grav  levels, 
making  it  dillicull  to  implement  such  an  optical  neural  net¬ 
work. 

In  this  paper,  an  optical  architecture  is  proposed,  in  which 
a  high  resolution  video  monitor  is  used  as  a  programmable 
weighting  matrix  as  well  as  an  incoherent  light  source  The 
major  advantages  of  this  proposer)  architecture  .,■*■  that  it 
alleviates  the  drawbacks  of  low  resolution  and  poor  Vnamic 
range  of  the  existing  SIMs  Tn  fur  I  her  increase  the  error- 
correction  ability,  an  orthogonal  proicction  (OP)  algorithm  is 
introduced  F.xperimental  and  computer  simulated  demonstra¬ 
tions  for  image  reconstruction  arc  provided 
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II.  HOPFIELD  MODEL 

A  model  to  describe  the  collective  behavior  of  the  neural 
network,  based  on  the  associative  process  of  the  human  brain, 
has  been  introduced  by  Hopfield  [4],  His  model  consists  of  a 
set  of  interconnected  neurons  that  operates  in  a  binary  state. 
The  output  from  each  neuron  is  assumed  dependent  on  the 
output  from  the  neighboring  neurons,  in  which  the  operation 
can  be  described  by  the  following  iterative  formula: 

K("+  1) -/(»,(»))  *,(»)-£  W")  (l> 

/-i 

where  /(  •)  represents  the  threshold  operation,  i.e., 

/«>-{_;  (2, 

Tu  is  the  strength  (i.e.,  weight  factor)  of  connection  between 
ith  and  yth  neurons,  F(rt)  is  the  input  value  to  ;th  neuron, 
N  represents  the  total  number  of  neurons  in  the  network,  and 
n  denotes  the  number  of  iterative  operations. 

The  Hopfield  model  begins  by  storing  a  set  of  input-out¬ 
put  vector  pairs  (U{m),  (/(m>),  m  -  1,2 . M,  in  a  neural 

network  with  the  aid  of  reorganized  connections,  where  vec¬ 
tors  U(m)  and  V,m)  are  N  bits  long,  corresponding  to  the 
number  of  neurons  in  the  network.  Thus  the  storage  prescrip¬ 
tion  can  be  expressed  by  a  collection  of  outer-product  vectors, 
as  given  by 

Tijm(  Z  ^Kim'-i){w;m'-i)  i+j  (3) 


In  the  case  of  identical  input-output  vector  pair  (Vim), 

TtJ  can  be  used  to  retrieve  the  stored  vector  from  an  incom¬ 
plete  or  partially  erroneous  input  V .  The  thresholded  product 
vector  can  be  written  as 

■wjlV'/J  (4) 


Figure  1  Partition  of  a  I  D  weight  matrix  T,k  into  an  array  of  2-D 
submatrices  TUl/,  T,2l).  •  •  •  ,  and  7"vv,; 

Notice  that  Eq  (4)  can  be  used  to  estimate  the  target  vector  V 
similar  to  the  input  vector  V,  for  which  we  have  used  the 
Hamming  distance  as  a  criterion  If  the  output  vector  is  fed 
back,  a  more  accurate  vector  may  be  obtained;  we  have 
assumed  that  the  iteration  would  converge  to  the  coned 
vector  for  a  stable  network 

Similarly,  for  a  2-D  neural  network  of  V  x  N  neurons,  the 
Hopfield  model  can  be  written  as 

,V  V 

K*("  *  1)  -/(0«)  1-H  -  L  L  T,kl,K,(n)  (5) 

'-I /-i 

where  V/t  and  Vu  represent  V  x  ,V  2-D  vectors  and  T,kn  is 
an  N2  x  4-D  IWM  [  1 1  Matrix  T  can  be  partitioned  into 
an  array  of  2-D  submatrices,  in  which  each  submatrix  is  an 
N  X  N  array,  as  depicted  in  Figure  1  Thus  a  4-D  IWM  can 
be  represented  by  an  array  of  2-D  submatrices 

III.  AN  ADAPTIVE  OPTICAL  NEURAL  NETWORK 

In  a  2-D  N  X  N  neural  network,  the  IWM  requires  an  SLM 
of  N*  elements  with  multiple  gray  levels  However,  such  SLMs 
are  not  quite  available  at  present  time 


Figure  2  Schematic  diagram  of  an  adaptive  optical  neural  network 
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We  shall  now  propose  an  adaptive  optical  neural  network 
in  which  a  high  resolution  video  monitor  is  used  to  display  the 
interconnection  weight  matrix  T  and  at  the  same  time  to 
provide  the  light  source  for  the  processing  operation,  as 
sketched  in  Figure  2.  Notice  that  the  proposed  system  differs 
from  the  matrix-vector  processor  of  Farhat  and  Psaltis  |1]  in 
that  the  locations  of  input  array  and  weighting  matrix  mask 
are  interchanged.  This  arrangement  makes  it  possible  to  use  a 
video  monitor  as  the  IWM  instead  of  using  a  low  resolution, 
poor  dynamic  range  SLM.  A  lenslet  array  consisting  of  N  x  N 
small  lenses  is  used  to  establish  the  optical  interconnections 
and  a  moderate  sized  programmable  SLM  with  N  x  N  bioary 
pixels  is  used  as  the  input  device.  As  illustrated  in  Figure  3, 
the  light  beam  emitted  from  each  block  of  the  TV  screen 
passes  through  a  specific  lens  of  the  lenslet  array  and  is 
imaged  onto  the  input  device  (i.e.,  SLM)  The  light  field 
behind  the  SLM  is  then  imaged  onto  the  output  plane  by  a 
imaging  lens  that  can  be  picked  up  by  a  photodetector  array 
(i.e.,  CCD).  Thus  it  forms  an  N  x  N  output  array,  which 
represents  the  product  of  the  4-D  matrix  T  and  the  2-D  input 
array. 

To  construct  a  closed  loop  neural  network,  the  output 
signals  from  the  detector  array  are  fed  back  to  the  input  SLM 
via  a  thresholding  circuit.  By  programming  the  interconnec¬ 
tion  weight  matrix  with  a  computer,  the  optical  neural  net¬ 
work  can  be  made  adaptive. 

A  ferroelectric  SLM  would  be  a  satisfactory  input  device  of 
the  system,  since  its  contrast  ratio  is  as  high  as  500:1. 
Moreover,  the  SLM  is  parallel  addressable— the  detector  ar¬ 
ray  and  the  input  array  can  communicate  in  parallel.  Thus  the 
whole  elcctrooptical  feedback  loop  can  be  established  in  a 
completely  parallel  fashion.  This  arrangement  allows  the  sys¬ 
tem  to  work  at  a  high  speed  and  in  an  asynchronous  mode. 
Although  the  interconnection  weight  matrix  (i.e.,  the  video 
monitor)  works  at  a  relatively  low  speed,  it  is  however  not 
required  for  the  programming  speed  to  match  the  iteration 
speed  in  the  loop.  Video  monitors  with  256  gray  levels  and 
1024  x  1024  pixels  are  commercially  available.  Based  on  this 
data,  one  may  build  a  hybrid  optical  neural  network  of 
32  x  32  (i.e.,  1024)  neurons  using  the  commercially  available 
video  monitor. 

IV.  EXPERIMENTAL  DEMONSTRATIONS 

To  show  the  feasibility  of  the  proposed  architecture,  an  opti¬ 
cal  neural  network  with  8x8  (i.e.,  64)  neurons  has  been  built 


using  a  Panasonic  black  and  white  video  monitor  of  384  x  512 
pixels  as  the  weight  matrix.  A  Seiko  liquid  crystal  TV  (LCTV) 
is  used  as  the  real-time  input  device  in  the  system  An  8  x  8 
lenslet  array  is  constructed  to  provide  the  interconnections 
between  the  memory  matrix  and  the  input  object.  The  output 
signals  are  picked  up  by  a  CCD  array  detector  and  then  sent 
to  a  microcomputer  for  the  thresholding  operation.  A  Data- 
Cube  AT-428  image  capture  and  display  module  is  used  to 
provide  the  interfacing  between  the  microcomputer.  CCD. 
LCTV  and  video  monitor. 

Figure  4  illustrates  an  image  reconstruction  process  using 
the  optical  neural  network  described  With  reference  to  the 
Hopfield  model  [i.e.,  Eq.  (3)J,  three  capital  letters  "A",  “B". 
and  "X”  are  stored  in  the  interconnection  weight  matrix  T 
Each  of  these  letters  occupies  a  8  x  8  array  pixels,  as  shown 
in  Figure  4(a)  In  our  experiments,  the  positive  and  the 
negative  parts  of  T  arc  sequentially  displayed  on  the  video 
monitor,  as  shown  in  Figures  4<b)  and  (c>.  respectively  An 
imperfect  object  of  letter  "X"  is  applied  at  the  input  SLM.  as 
shown  at  the  left  side  of  Figure  4(d)  By  sequentially  display¬ 
ing  the  positive  and  the  negative  parts  of  T  onto  the  video 
monitor,  the  output  images  are  captured  by  the  CCD  camera, 
which  is  then  sent  to  the  microcomputer  for  subtraction  and 
thresholding  operations  Thus,  a  recovered  pattern  can  be 
obtained,  as  shown  in  the  right  side  of  Figure  4(d)  Needless 
to  say,  the  positive  and  negative  parts  of  T  can  be  added  with 
a  bias  level  to  avoid  the  negative  quantity  and  a  single  step 
operation  can  be  achieved  by  thresholding  the  output  signals 

V.  ORTHOGONAL  PROJECTION  (OP)  ALGORITHM 

Although  the  error-correction  ability  of  the  Hopfield  model  is 
rather  effective,  its  correction  ability  decreases  rapidly  as  the 
number  of  stored  patterns  increases  In  order  to  obtain  the 
desired  results,  the  number  of  stored  vectors  M  in  the 
Hopfield  model  must  be  sufficiently  smaller  as  compared  with 
the  number  of  neurons  V,  i.e  .  M  <  ,V/4ln  V,  as  pointed  out 
by  Farhat  et  al.  [3|,  and  each  stored  vector  should  also  be 
independent.  However,  in  practice,  the  stored  vectors  are 
generally  not  independent:  this  nav  produce  some  ambiguous 
results.  In  computer  simulation,  we  have  used  an  orthogonal 
projection  algorithm  to  improve  the  error-correction  abilitv  of 
the  Hopfield  model  The  OP  algorithm  is  described  in  the 
following: 

Consider  an  ,V-dimcnsional  vector  space,  in  which  there 
are  M  vectors  m  ~  1.2.  ,  M.  of  V  bits  in  length 
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This  set  of  vectors  { V<m) }  will  construct  a  weight  matrix  T. 
The  basic  concept  about  the  OP  algorithm  is  to  project  each 
vector  in  the  vector  set  ( }  to  the  orthogonal 

subspace  spanned  by  the  column  vectors  V{m),  m  — 

1,2 . m0  -  1.  The  orthogonal  projection  vector  can  be 

obtained  from  a  Gram-Schmidt  orthogonaiization  procedure 
[11],  such  as 


m°-l  /  y\m)  y<  m)  \ 

Vim o‘ =  -  V  - ’  -  -  V(m) 

ir,  ir,m,n 


(6) 


where  (k'*'"1,  V(ml)  denotes  the  inner  product  of  two  vectors 
Vi"'>  and  and  ||f/*('",||  is  the  quadratic  vector  norm  of 

y*i m) 

For  a  given  matrix  the  recursive  algorithm  for  the 

associative  memory  matrix  T,m)  can  be  expressed  as 


y*<»i t-I) 

-  l>  j/i  «i)  \ 

for  ||r*<'"’||  *  0 

j'(  m  -  l) 

otherwise 

(7) 


where  t/<m|  stands  for  the  desired  output  vector  The  initial 
memory  matrix  T{0)  can  be  either  a  zero  or  an  identity  matrix 
Using  the  OP  algorithm  as  described,  computer  simula¬ 
tions  have  been  conducted  and  the  results  obtained  are  shown 
in  Figure  5  Four  letters,  “A",  “B”,  “W,”  and  “X"  are  used  as 
the  reference  patterns,  as  shown  in  Figure  5(a)  By  applying 
Eqs.  (6)  and  (7),  the  weight  matrix  T  is  constructed  Figures 
5(b)  and  (c)  illustrate  the  reconstruction  of  the  letter  “X” 
from  a  partial  image,  by  using  the  OP  algorithm  and  the 
Hopfteld  model,  respectively.  The  input  pattern  is  a  small 
portion  of  pattern  X,  which  is  displayed  on  the  left  side  of 
Figures  5(b)  and  (c),  respectively  The  successive  patterns,  as 
displayed  in  these  figures,  represent  the  output  of  successive 
iterations.  Under  the  same  conditions,  the  OP  algorithm  is 
more  robust  and  has  a  higher  convergent  speed  than  the 
Hopfield  model,  as  can  be  seen  in  these  figures  In  this 
example,  the  OP  algorithm  requires  only  one  iteration  [see 
Figure  5(a)|,  while  the  Hopfield  model  converges  after  three 
iterations  [see  Figure  5(b)) 

VI.  DISCUSSION 

The  advantages  of  using  a  video  monitor  as  the  memory 
matrix  are  its  high  resolution  (e  g  ,  1024  x  1024  pixels),  large 
dynamic  range  (about  256  gray  levels),  and  low  cost  A  further 


(a) 


(di 


Figure  4  ExpenmentaJ  result  of  an  image  reconstruction  process  (a)  Three  capital  letters  to  be  stored  in  ihc  sscight  matrix  (b)  and  (c) 
Positive  and  negative  weight  matrix  of  Hopfield  model  ' d )  Reconstruction  ol  paticrn  X  bs  using  ihc  opiaal  neural  network 
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(C)  • 


Figure  S  (a)  Four  letters  to  be  stored  in  the  weight  matrix,  (b)  and  (c)  Reconstruction  of  pattern  A  bv  using  both  the  OP  algorithm  and 
the  Hopfield  model,  respectively 


development  of  high-definition  TV  technology  would  enable 
us  to  build  an  even  larger  neural  network  with  higher  speed. 
Currently,  integrated  optics  technology  may  provide  us  with  a 
microlens  array  containing  30,000  interconnections  on  a  glass 
substrate  [14],  Given  the  addressing  time  of  the  ferroelectric 
SLM  on  the  order  of  10' 5  s  and  TV  frame  rate  of  30  frames 
per  second,  the  operation  speed  of  the  proposed  system,  with 
1024  fully  interconnected  neurons,  can  be  as  high  as  105  x 
1024  x  1024  -  1.05  x  10“  interconnection  operations  per 
second,  and  the  learning  process  would  have  a  speed  of 
30  x  1024  x  1024  -  3.146  x  107  operations  per  second. 

Notice  that  modifications  of  the  Hopfield  model,  such  as 
the  orthogonal  projection  and  the  multilevel  recognition  algo¬ 
rithms  have  been  applied  in  the  proposed  system  This  pro¬ 
posed  neural  network  can  also  be  used  to  implement  multi¬ 
layer  self-learning  algorithms  and  high-order  neural  networks, 
as  will  be  discussed  in  our  forthcoming  papers. 
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ABSTRACT 

A  theoretical  model  is  presented  for  the  analysis  of  microstnp  mull  icon- 
ductor  structures  embedded  in  anisotropic  lossless  nonmagnetic  multilay¬ 
ered  dielectric  media  with  finite  strip  thickness.  The  model  reduces  the 
thick  conductor  problem  to  the  thin  strip  case.  Calculations  are  made  in 
the  spectral  domain.  Numerical  results  are  given  and  compared  with 
published  data. 

I.  INTRODUCTION 

The  TEM  transmission-line  properties  of  a  microstnp  on 
anisotropic  lossless  nonmagnetic  multilayered  substrates  can 
be  characterized  by  three  parameters:  the  capacitance  C,  the 
capacitance  without  the  substrate  C,.  and  the  senes  resistance 
R  The  solutions  for  C  and  Cv  are  usually  obtained  by 
supposing  that  the  strip  is  infinitely  thin.  However,  strip 
thickness  may  have  an  important  influence  on  the  values  of  C 
and  C,.,  especially  in  MMICs  and  MICs  using  thick  film 
technology  Also,  the  thickness  of  metallizations  must  be 
taken  into  account  to  determine  the  series  resistance  R  by 
using  the  incremental-inductance  r.'le  [1| 

Several  general  methods  are  currently  available  to  solve  the 
problem  of  the  thick  strip  on  multilayered  substrate,  such  as 
the  finite-element  method  (2|,  the  network  analog  approach 
(3|,  and  the  finite  difference  method  |4|  In  spite  of  their 
generality,  these  methods  involve,  in  many  cases,  an  extremely 
large  computation  time  and  so  they  may  not  be  suitable  to  be 
put  into  a  more  general  design  or  analysis  program  There  are 
also  other  useful  methods  when  simple  substrates  are  to  be 
considered.  These  methods  can  be  divided  into  two  general 


types:  the  integral  equation  methods  (5,  6]  and  the  approxi¬ 
mate  conformal  mapping  techniques  |7|  For  a  more  general 
structure  including  anisotropic  and  multilayered  dielectric  me¬ 
dia,  it  may  be  rather  difficult  to  apply  these  methods  even  if 
strip  thickness  is  neglected.  In  this  paper,  we  present  a  new 
model  to  study  the  influence  of  metallization  thickness  on  the 
characteristic  parameters  of  planar  transmission  lines.  This 
model  is  applied  to  the  analysis  of  a  single  microstrip  on  an 
anisotropic  lossless  nonmagnetic  multilayered  substrate 

II.  THE  M-STRIPS  MODEL 

Figure  1(a)  shows  the  cross  section  of  the  generic  subject  line 
and  Figure  1(b)  shows  the  model  suggested  In  (his  model,  the 
thick  strip  has  been  removed  and  replaced  by  a  set  of  M 
infinitely  thin  strips;  the  charge  is  allowed  to  flow  among  them 
until  the  strips  reach  the  same  potential. 

These  structures  are  equivalent  when  the  number  of  strips 
M  goes  to  infinity.  When  M  is  a  finite  number,  the  electric 
energy  of  both,  the  real  structure  and  the  model,  is  only 
similar.  Dealing  with  this  model  we  can  use  the  methods 
previously  developed  to  compute  the  transmission-line  param¬ 
eters  when  the  thickness  of  metallization  is  neglected  (thin 
strip  case). 

//./.  Method  of  Analysis 

a.  Variational  algorithm.  In  the  spectral  domain,  the  electric 
energy  per  unit  length  of  the  structure  shown  in  Figure  1(b), 
can  be  expressed  as  a  function  of  the  charge  densities  on  the 
conductors  as 

1  m  m  x 

q;(p)c,l{p)q,(p)dp  <i> 

1-1  /-I  -» 

where  q,iP)  is  the  Fourier  transform  of  the  charge  density  on 
the  ith  strip  a,(x)  and  G,,(/f)  is  the  Fourier  transform  of  the 
Green's  function  G(  x,  x':  i;,  r ' ).  where  x'  =  0  and  i,.  y'  the 
coordinates  of  the  ith  and  ;th  stops,  respectively 

The  expression  given  in  (1)  for  cncrgv  is  variational  The 
equivalence  between  the  energy  of  the  real  and  the  model 
structure  when  M  goes  to  infinity  is  guaranteed  by  the  addi¬ 
tional  condition 

M 

E  P  2  <M  >)./«  =  1  (2) 

.-i 1  «-'J 

The  total  charge  on  the  strips  is  Q  -  I 

The  charge  distribution  on  each  strip  is  now  represented  bs 
a  set  of  functions  in  the  following  way 

r)  -  £  ai r;(  t )  (3) 

A  -0 

where  r,'(r)  arc  the  trial  functions  and  a{  arc  variational 
coefficients  to  be  computed 

A  mathematical  requirement  is  now  imposcJ  on  the  trial 
functions  in  order  to  simplify  the  problem 

P/  2  f«(  «  )  </»  - 
1  « ,2 
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Two-dimensional  programmable  optical  neural  network 


Taiwei  Lu,  Shudong  Wu,  Xin  Xu,  and  Francis  T.  S.  Yu 


A  2-D  hybrid  optical  neural  network  using  a  high  resolution  video  monitor  as  a  programmable  associative 
memory  is  proposed.  Experiments  and  computer  simulations  of  the  system  have  been  conducted.  The  high 
resolution  and  large  dynamic  range  of  the  video  monitor  enable  us  to  implement  a  hybrid  neural  network  with 
more  neurons  and  more  accurate  operation.  The  system  operates  in  a  high  speed  asynchronous  mode  due  to 
the  parallel  feedback  loop.  The  programmability  of  the  system  permits  the  use  of  orthogonal  projection  and 
multilevel  recognition  algorithms  to  increase  the  robustness  and  storage  capacity  of  the  network. 


I.  Introduction 

In  recent  years  attention  has  been  paid  to  problems 
concerning  the  optical  implementation  of  neural  net¬ 
works.1-10  A  2-D  optical  neural  network  has  been 
synthesized  by  Farhat  and  Psaltis,  for  which  they  used 
the  basic  concept  of  vector-matrix  optical  processing.1 
This  optical  neural  network  is  composed  of  a  linear 
array  of  LEDs  as  an  input  device,  which  is  intercon¬ 
nected  to  a  weighting  mask  by  a  lenslet  array.  To 
provide  the  network  with  self-organization  and  learn¬ 
ing  capabilities,  a  programmable  spatial  light  modula¬ 
tor  (SLM)  with  fine  resolution  and  a  large  number  of 
distinguishable  grey  levels  is  needed  as  a  weighting 
mask.  However,  the  currently  available  SLMs  gener¬ 
ally  have  very  limited  space-bandwidth  products,  few¬ 
er  grey  levels,  and  high  cost,  which  make  it  difficult  to 
implement  Buch  an  optical  neural  network. 

In  this  paper,  we  propose  an  optical  architecture  in 
which  a  high  resolution  video  monitor  is  used  to  dis¬ 
play  the  interconnection  weight  matrix  (IWM).  The 
video  monitor  also  provides  the  incoherent  light  source 
for  processing.  This  proposed  optical  neural  network 
alleviates  the  low  resolution  and  limited  dynamic 
range  problem  for  generating  the  IWM  encountered  in 
previous  investigations.  To  increase  further  the  error 
correction  and  system  storage  capacities,  orthogonal 
projection  (OP)  and  multilevel  recognition  (MR)  algo- 
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rithms  are  used.  Experiments  and  computer  simula¬ 
tions  of  pattern  reconstruction  using  the  proposed  op¬ 
tical  neural  network  are  provided. 

II.  Description  ol  the  Hoplield  Model 

Based  on  the  process  of  association  by  which  the 
human  brain  stores  information,  various  models  have 
been  introduced  to  describe  the  collective  behavior  of  a 
neural  network.  Among  them,  the  Hopfield  model1 1  is 
a  single  layer  neural  network  with  an  outer  product 
learning  algorithm,  which  can  also  be  found  in  the 
earlier  literature.12'111 

The  Hopfield  model  consists  of  a  set  of  neurons 
which  are  mutually  interconnected.  He  assumed  that 
each  neuron  operates  in  a  binary  state.  The  output 
from  each  neuron  depends  on  the  output  of  the  neigh¬ 
boring  neurons.  With  this  assumption,  the  operation 
of  a  neuron  can  be  described  by  an  iterative  formula,  as 
given  by 

N 

V,(n  +  1)  *  /|v,(n)|,  v,(n)  =  \  T^V^n),  (1) 

/-I 

where  f(-)  represents  the  threshold  operation,  namely. 


In  Eq.  (I),  Ttl  is  the  strength  or  the  weight  factor  of  the 
connection  between  the  ith  and  ;th  neurons,  and  Vj{n) 
is  the  input  value  to  the  jth  neuron  for  the  nth  itera¬ 
tion,  N  represents  the  number  of  neurons  in  the  net¬ 
work,  and  n  denotes  the  number  of  iterative  opera¬ 
tions. 

Note  that  the  Hopfield  model  begins  by  storing  a 
set  of  input-output  vector  pairs  |U(ml,V,m,|,  m  = 
1,2,  ...  M  in  a  neural  network  with  the  aid  of  reorga¬ 
nized  connections.  Vectors  U,m)  and  \'m)  are  N  hits 
long,  which  equals  the  number  of  neurons  N  in  the 
network.  The  storage  prescription  can  be  expressed 
by  a  collection  of  outer  product  vectors,  such  as 
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£  l2Vj"*  -  1)(2U}"*’  -  1],  i  *  j, 

<n«  1 

0,  i-j. 


(3) 


T 

T 

r  ... 

n  ij 

I2ij 

1  Nij 

In  the  case  of  an  identical  inputr-output  vector  pair 
Tij  may  be  used  to  retrieve  the  stored  infor¬ 
mation  about  a  certain  vector  V',  which  is  incomplete 
or  partially  erroneous.  The  thresholded  product  vec¬ 
tor  can  be  written  as 


This  relationship  estimates  the  target  vector  V  that  is 
most  similar  to  the  input  vector  V'.  The  Hamming 
distance  is  used  as  a  measure  of  their  similarity.  If  the 
output  vector  is  used  as  the  next  input  vector  (i.e.,  first 
iteration),  the  new  output  vector  would  be  closer  to  the 
stored  vector,  where  we  assume  that  the  iteration 
would  converge  to  the  correct  vector  in  a  stable  net¬ 
work. 

For  a  2-D  neural  network  with  TV  X  TV  neurons,  the 
Hopfield  model  can  be  extended  to  the  following  form: 

N  N 

V„(r»  +  1)  -  /<utt),  Vlk  -  £  £  T^V./n),  (5) 

i«l  ;-l 

where  V»  and  Vly  represent  2-D  vectors  (i.e.,  patterns) 
and  Tikij  is  a  4-D  interconnection  weight  matrix.1 

We  note  that  matrix  T  can  be  partitioned  into  an 
array  of  TV  X  TV  submatrices,  and  each  submatrix  has  an 
TV  X  TVsize,  as  depicted  in  Fig.  1.  Thus  we  see  that  a  4- 
D  memory  matrix  can  be  easily  extended  by  arrays  of 
2-D  submatrices. 

I.  Hybrid  Optical  Neural  Network 

The  major  difficulty  in  implementing  2-D  neural' 
networks  is  the  actual  construction  of  the  weighting 
matrix  T  using  real  time  SLMs.  For  an  TV  X  TV  neural 
network,  the  weighting  matrix  requires  an  SLM  of  TV4 
elements  with  several  grey  levels.  However,  the  cur¬ 
rently  available  SLMs  provide  poor  resolution  and  a 
limited  number  of  grey  levels,  which  limit  the  process¬ 
ing  capacity  of  the  neural  network. 

We  propose  a  programmable  optical  neural  network 
in  which  a  high  resolution  video  monitor  is  used  to 
display  the  IWM,14  as  shown  in  Fig.  2.  This  proposed 
system  differs  from  the  matrix-vector  processor  of 
Farhat  and  Psaltis,  in  which  the  positions  of  the  input 
SLM  and  IWM  have  been  exchanged.  We  note  that 
this  arrangement  makes  it  possible  to  use  a  video  moni¬ 
tor  for  associative  memory  matrix  generation  instead 
of  a  low  resolution  and  low  contrast  SLM.  Again  a 
lenslet  array  consisting  of  TV  X  TV  small  lenses  is  used  to 
establish  the  optical  interconnections  between  the 
IWM  and  input  patterns,  where  a  moderate  sized  SLM 
with  TV  X  TV  binary  pixels  serves  as  the  input  device. 
As  depicted  in  Fig.  3,  the  light  beam  emitted  for  each 
submatrix  from  the  video  screen  would  be  imaged  by  a 
specific  lens  of  the  lenslet  array  onto  the  input  SLM. 
Thus  TVX  TV  submatrices  would  be  added  to  the  input 
device.  The  overall  transmitted  light  can  be  imaged  at 
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Fig.  1.  Partition  of  a  4-D  matrix  Tu,,  into  an  array  of  2-D  subma- 
tricea  T|i,;,  Tij,,.  ....  and  T nn,,- 
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Fig.  2.  Schematic  diagram  of  a  hybrid  optical  neural  network. 
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Fig.  3.  Optical  arrangement  of  the  neural  network. 


the  output  plane  to  form  an  TV  X  TV  output  array,  which 
represents  the  product  of  the  4-D  matrix  and  the  2-D 
input  pattern.  Needless  to  say,  the  output  pattern  can 
be  picked  up  by  an  TV  X  TV  photodetector  array  for 
thresholding  and  feedback  iterations. 

To  form  a  closed  loop  neural  network  operation,  the 
output  signals  from  the  detector  array  are  fed  back  to 
the  input  SLM  via  a  thresholding  circuit.  It  is  appar¬ 
ent,  by  the  intervention  of  a  computer,  that  the  pro¬ 
posed  optica]  neural  network  can  be  made  adaptive. 

We  propose  that  a  ferroelectric  liquid  crystal  SLM 
be  used  as  the  input  device  of  the  system.  According¬ 
ly,  its  contrast  ratio  can  be  as  high  as  125:1. 17  Since 
the  SLM  can  be  addressed  in  parallel,  the  detector  and 
input  arrays  can  communicate  in  parallel.  Thus  the 
electrooptic  feedback  loop  can  be  performed  in  a  com- 
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pletely  parallel  manner.  This  arrangement  would  al¬ 
low  the  system  to  operate  in  a  high  speed  asynchronous 
mode.  Thus  the  sequential  electronic  bottleneck  can 
be  alleviated  to  some  extent  with  the  feedback  loop. 
Although  displaying  memory  matrices  using  a  video 
monitor  is  relatively  slow,  the  programming  speed  of 
the  1WM  is  not  required  to  match  the  iteration  speed 
in  the  feedback  loop.  Accordingly,  1024-  X  1024-pixel 
video  monitors  are  available  commercially,  for  which  it 
is  possible  to  build  a  hybrid  optical  neural  network 
with  32  X  32  (i.e.,  1024)  neurons. 

The  resolution  requirement  of  the  lenslet  array  is 
modest.  An  array  of  32  X  32  lenses,  each  with  a  diame¬ 
ter  of  2.5  mm,  can  provide  at  least  10  times  the  resolu¬ 
tion  of  a  commercial  TV  monitor,  which  has  a  resolu¬ 
tion  of  ~3  lines/mm. 

However,  alignment  of  the  optical  system  is  rather 
critical  for  the  matrix-vector  operations.  The  subma¬ 
trices  on  the  TV  screen  must  be  precisely  imaged  onto 
the  input  SLM  by  the  lenslet  array  in  a  superimposing 
position.  Since  the  proposed  optical  neural  network  is 
essentially  a  closed-loop  feedback  system,  the  precise 
alignment  can  be  corrected  by  adjusting  the  position  of 
each  submatrix  on  the  TV  screen  using  the  computer. 
The  intensity  of  the  TV  screen  can  also  be  adjusted. 
Thus  the  proposed  optical  system  can  indeed  perform 
in  an  adaptive  mode. 

IV.  Experimental  Demonstrations 

To  demonstrate  the  feasibility  of  the  proposed  ar¬ 
chitecture,  a  2-D  optical  neural  network  with  8X8  (i.e., 
64)  neurons  has  been  built.  The  experimental  setup  is 
shown  in  Fig.  4.  A  Sony  video  monitor  of  384  X  512 
pixels  is  used  to  generate  the  associative  memory  ma¬ 
trix.  An  8  X  8  lenslet  array  (/  =  125  mm,  0  =  15  mm) 
that  provides  the  interconnections  between  the  memo¬ 
ry  matrix  and  input  SLM  is  constructed.  The  output 
signals  are  picked  up  by  a  Fairchild  CCD  camera  and 
then  sent  to  a  microcomputer  for  thresholding  opera¬ 
tion.  A  Data-Cube  AT-428  image  capture  with  a  dis¬ 
play  module  is  used  to  provide  the  interfacing  among 
the  microcomputer,  input  SLM,  CCD  detector,  and 
TV  monitor.  We  have  used  a  transparency  instead  of 
a  ferroelectric  SLM  for  the  preliminary  experimental 
demonstrations.  Note  that  a  Seiko  liquid  crystal  tele¬ 
vision  (LCTV)  built  with  thin  film  transistor  (TFT) 
technology  has  also  been  used  as  a  real  time  input  SLM 
in  our  later  experiments. 

Figure  5  illustrates  an  image  reconstruction  process 
based  on  the  system  described  above.  With  reference 
to  the  Hopfield  model  (i.e.,  Eq.  (3)|,  four  letters,  A,  B, 
W,  and  X,  are  stored  in  the  memory  matrix  T.  Each 
letter  occupies  an  8  X  8  array  pixel,  as  shown  in  Fig. 
5(a).  The  positive  and  negative  parts  of  the  memory 
matrix  T  are  shown  in  Figs.  5(b)  and  (c),  respectively. 
As  depicted  in  Fig.  5(d),  an  imperfect  image  of  A  is  fed 
to  the  input  SLM  of  the  system  [see  the  leftmost  pat¬ 
tern  in  Fig.  5(d)}.  The  positive  and  negative  parts  of 
the  memory  matrix  are  sequentially  displayed  on  the 
video  monitor  using  the  microcomputer.  The  positive 
and  negative  output  images  are  picked  by  the  CCD 


Fig.  4.  Experimental  setup.  Left  to  right:  TV  monitor,  8x8 
lenslet  array,  LCTV,  imaging  lens,  and  CCD  camera. 


(d) 

Fig.  5.  Experimental  result  of  an  image  reconstruction  process: 
(a)  four  capital  letters  stored  in  the  memory  mask;  (hi,  (c)  positive 
and  negative  memory  masks  of  the  Hopfield  model;  (d>  reconstruc¬ 
tion  of  pattern  A  by  using  the  optical  neural  network. 


camera  and  then  sent  to  the  microcomputer  for  sub¬ 
traction  and  thresholding  operations.  Thus  a  partial¬ 
ly  recovered  pattern  is  obtained  at  the  output  end,  as 
shown  in  the  middle  of  Fig.  5(d).  Since  the  output 
pattern  is  not  quite  complete,  this  pattern  is  fed  back 
to  the  input  SLM  for  another  iteration,  a  more  com¬ 
pletely  recovered  pattern  can  be  found  at  the  output 
plane,  which  is  depicted  on  the  right-hand  side  of  Fig. 
5(d).  Needless  to  say,  the  positive  and  negative  parts 
of  T  can  be  added  with  a  bias  level  to  avoid  the  nega¬ 
tive  quantity,  in  which  a  single  step  operation  can  be 
achieved  by  properly  thresholding  the  output  signals. 
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V.  Orthogonal  Projection  Algorithm 

The  error  correction  ability  of  the  Hopfield  model  is 
effective  with  the  assumption  that  the  stored  vectors 
are  significantly  different.  The  correction  ability  de¬ 
creases  rather  rapidly  as  the  number  of  stored  patterns 
increases.  To  obtain  the  desired  results,  the  number 
of  stored  vectors  M  in  the  Hopfield  model  should  be 
sufficiently  smaller  than  the  number  of  neurons  in  the 
network,  as  pointed  out  by  Farhat  et  al.,2  i.e.,  M  <  N/ 4 
InIV.  However,  in  practice,  the  stored  vectors  are  gen¬ 
erally  not  independent,  and  some  ambiguous  output 
results. 

We  note  that  orthogonization  techniques  have  been 
used  in  associative  memory  and  digital  image  process¬ 
ing.1215  In  this  section,  we  use  the  orthogonal  projec¬ 
tion  (OP)  algorithm  to  improve  the  error  correction 
ability  of  the  optical  neural  network. 

The  OP  algorithm  can  be  described  as  follows: 

Let  us  consider  an  /V-dimensional  vector  space  con¬ 
sisting  of  a  set  of  M  vectors  V(m),  which  will  be  used  to 
construct  an  interconnection  weight  matrix  T.  The 
basic  concept  of  the  OP  algorithm  is  to  project  each 
vector  V(mo'  within  the  vector  set  |V<m,|  onto  the  or¬ 
thogonal  subspace  spanned  by  the  independent  vec¬ 
tors  V*(m>,  m  =  1,2 . .  -  1.  The  orthogonal  pro¬ 

jection  vector  can  be  described  by  the  Gram-Schmidt 
orthogonalization  procedure,'8  such  as 

y  lV<"",V,l’,l[  v,-,  (6, 

m-1  1  1 

where  denotes  the  inner  product,  and 

||  is  the  norm  of  V*(m|. 

Hence,  for  a  given  matrix  T(m~",  the  recursive  algo¬ 
rithm  for  the  associative  memory  matrix  T<m)  can  be 
expressed  as 


t*"'1'  +  |U|,",  -  T1'"'l,V<mll  — - .  for  *  0, 

T"*-1’,  otherwise, 


(7) 


where  U(m(  stands  for  the  desired  output  vector,  and 
the  initial  memory  matrix  T(0)  can  be  either  a  zero  or  an 
identity  matrix. 

Using  the  OP  algorithm  described  above,  computer 
simulation?  of  the  proposed  optical  neural  network 
have  been  conducted,  and  the  result  is  in  Fig.  6.  Note 
that  four  capital  letters,  as  in  Fig.  5(a),  are  used  for  the 
reference  patterns.  By  applying  Eqs.  (6)  and  (7),  the 
associative  memory  matrix  T  is  constructed,  for  which 
the  positive  and  negative  parts  of  T  are  shown  in  Figs. 
6(a)  and  (b).  The  reconstruction  of  a  partial  pattern 
of  letter  A  by  using  the  OP  algorithm  and  Hopfield 
model  is  shown  in  Figs.  6(c)  and  (d),  respectively.  The 
successive  patterns  in  these  figures  represent  the 
successive  iterations.  Thus  we  see  that  the  OP  algo¬ 
rithm  is  generally  more  robust  and  has  a  higher  conver¬ 
gent  speed  compared  with  the  Hopfield  model.  Fur¬ 
thermore,  in  this  example  the  OP  algorithm  requires 
only  two  iterative  operations  to  obtain  the  correct  re- 
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Fig.  6.  («).  (b)  Positive  and  negative  memory  masks  of  the  OP 

algorithm,  (c)  Reconstruction  of  pattern  A  by  using  both  the  OP 
algorithm  and  Hopfield  model,  respectively 


suit  [Fig.  6(c)).  In  contrast,  the  Hopfield  model  con¬ 
verges  into  a  local  minima,  which  gives  an  incorrect 
result  [Fig.  6(d)). 

A  numerical  analysis  of  the  robustness  of  an  8-  X  8- 
neuron  single  layer  neural  network  is  evaluated. 
Twenty-six  capital  English  letters  are  used  as  the  ref¬ 
erence  patterns,  each  occupying  an  8  X  8  pixel  array. 
The  average  Hamming  distance  of  the  reference  pat 
terns  is  ~26  pixels,  and  the  minimum  distance  is  4 
pixels.  We  assume  that  the  input  patterns  are  embed¬ 
ded  in  random  noise,  where  the  input  SNIts  are  chosen 
to  be  ~5  dB  (i.e.,  50%  noise),  7  dB  (i.e.,  33%  noise),  and 
10  dB  (i.e.,  10%  noise),  respectively.  Figure  7  repre¬ 
sents  the  output  error  pixels  against  the  number  of 
stored  patterns  for  various  values  of  an  input  SNH. 
From  this  figure,  we  see  that  using  the  Hopfield  model 
the  neural  network  becomes  unstable  after  storing  five 
reference  patterns.  However,  using  the  OP  algorithm, 
the  neural  network  can  retrieve  all  the  letters  with  50% 
input  noise  for  twenty-six  stored  letters.  We  also  note 
that  the  error  correction  ability  decreases  substantial¬ 
ly  as  input  noise  and  the  number  of  stored  patterns 
increase.  Nevertheless,  the  OP  algorithm  generally 
provides  better  error  correction  capability. 

VI.  Mutllevel  Recognition  Algorithm 

For  the  case  of  an  i!l-condit:oned  weight  matrix,  the 
Hamming  distances  between  the  stored  vectors  are 
very  short,  which  may  result  in  the  Hopfield  model  in 
incorrect  results.  For  example,  four  capital  English 
letters,  T,  I,  0,  and  G,  are  stored  in  the  associative 
memory  matrix,  as  shown  in  Fig.  8(a).  Although  the 
input  pattern  is  a  partial  letter  G,  the  Hopfield  neural 
network  failed  to  reproduce  the  pattern  for  which  the 
output  result  falls  into  a  local  minima,  ns  shown  in  Fig. 
8(b).  We  note  that,  in  some  cases,  the  output  would 
not  converge  to  a  correct  result,  even  when  the  input  is 
exactly  the  same  as  one  of  the  reference  patterns.  In 
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Fig.  7.  Performance  of  the  Hopfield  and  OP  models. 
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Fig.  8.  (a)  Four  letters  stored  in  the  memory  mask,  (b)  Recon¬ 
struction  of  G  by  using  the  Hopfield  model. 

other  words,  the  Hopfield  model  is  effective  only  in 
dealing  with  independent  patterns. 

From  the  above  example  we  see  that  the  smaller  the 
Hamming  distances  among  the  stored  patterns,  the 
less  the  error  correction  ability.  However,  it  is  also 
known  that  the  less  information  stored  in  the  memory, 
the  more  effectively  the  neural  network  can  correct  the 
error.  Using  the  advantages  of  the  programmability 
of  the  proposed  optical  neural  network,  a  multilevel 
recognition  (MR)  algorithm  is  developed.  This  algo¬ 
rithm  adopts  the  tree  search  strategy  that  increases  the 
error  correction  ability  by  reducing  the  number  of 
vectors  stored  in  each  memory  matrix.19  The  MR 
algorithm  first  classifies  the  reference  patterns  into 
subgroups  and  then  develops  a  tree  structure  accord¬ 
ing  to  the  similarity  (i.e.,  Hamming  distance)  of  the 
reference  patterns.  A  smaller  number  of  reference 
patterns  can  be  stored  in  the  memory  matrix  built  for 
each  subgroup.  The  MR  algorithm  then  changes  the 
memory  matrices  with  reference  to  the  Hamming  dis¬ 
tances  between  the  intermediate  result  and  the  pat¬ 
terns  in  different  subgroups.  In  this  manner,  the  stor¬ 
age  capacity  is  not  limited  by  the  size  of  the  neural 
network.  However,  the  trade-off  is  that  the  process¬ 
ing  speed  is  slowed  down  due  to  changes  in  the  memory 
matrices. 
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Fig.  9.  Three  subgroups  of  letters  used  in  the  MR  algorithm,  (b), 
(c)  Reconstruction  of  G  by  Tto  and  Tog.  respectively. 


Fig-  10.  Flow  chart  diagram  of  the  MR  algorithm. 


As  an  example,  we  consider  once  more  the  four  let¬ 
ters  shown  in  Fig.  8(a).  According  to  the  similarity  of 
the  patterns,  the  above  four  letters  can  be  classified 
into  two  groups,  namely,  [O.G]  and  (T,I),  T  and  0  are 
arbitrarily  selected  from  these  two  subgroups  to  form  a 
root  group  [T.Ol,  as  shown  in  Figs.  9(a),  (b),  and  (c), 
respectively.  Instead  of  constructing  an  associative 
memory  matrix  Ttioc,  three  submemory  matrices, 
Tto>  Tog,  and  Tti,  are  composed  and  stored  in  the 
microcomputer.  In  the  first  demonstration,  the  mem¬ 
ory  matrix  Tot  is  displayed  on  the  video  monitor,  and 
an  input  vector  V',  which  represents  the  partial  image 
of  G,  is  presented  on  the  input  SLM  of  the  system. 
After  converging  to  a  stable  state,  the  output  vector 
V*,  as  shown  in  Fig.  9(d),  is  compared  with  the  stored 
vectors  0  and  T  by  using  the  Hamming  distance  as  a 
criterion.  More  specifically,  if  the  Hamming  distance 
between  the  vectors  V*  and  O  is  shorter  than  that  of  T, 
the  memory  matrix  Tog  will  be  used  to  replace  the 
matrix  Tot-  Afterward,  the  input  vector  V*  is  fed  into 
the  network  for  a  new  round  of  iteration,  for  which  the 
letter  G  is  retrieved,  as  shown  in  Fig.  9(e).  A  flow  chart 
diagram  to  illustrate  this  tree  search  operation  is 
shown  in  Fig.  10. 
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VI.  Conducing  Remarks 

A  video  monitor  displaying  the  IWM  offers  the  ad¬ 
vantages  of  high  resolution  (1024  X  1024  pixels  or 
more),  a  large  dynamic  range  (~256  grey  levels),  and 
low  cost.  Further  development  of  high  definition  TV 
technology  would  enable  us  to  synthesize  even  larger 
neural  networks  with  higher  speed  operation.  Cur¬ 
rently,  integrated  optics  technology  may  provide  a  mi¬ 
crolens  array  containing  30,000  interconnections  on  a 
glass  substrate.20  Given  an  addressing  time  of  the 
ferroelectric  SLM  of  the  order  of  10“4  s  and  a  TV  frame 
rate  of  30  frames/s,  the  operational  speed  of  the  pro¬ 
posed  system  with  1024  fully  interconnected  neurons 
can  be  as  high  as  104  X  1024  X  1024  =  1.05  X  1010 
operations/s.  However,  if  the  MR  algorithm  is  used, 
in  which  the  operation  speed  is  dependent  on  the  ad¬ 
dressing  speed  of  the  TV  monitor,  the  system  would 
have  a  speed  of  30  X  1024  X  1024  =»  3.146  X  107 
operations/s. 

Modifications  of  the  Hopfield  model,  such  as  the 
orthogonal  projection  and  multilevel  recognition  algo¬ 
rithms,  are  implemented  in  the  proposed  system  as 
shown  in  this  paper.  We  stress  that  the  proposed 
optical  neural  network  can  also  be  used  to  implement 
multilayer  and  high-order  neural  networks.  The  pre¬ 
liminary  experimental  demonstrations  and  simulated 
results  have  revealed  that  the  proposed  optical  neural 
network  possesses  high  programmability  and  parallel 
operation,  which  in  principle  can  be  made  highly  adap¬ 
tive. 
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Using  an  optical  disk  as  a  large  capacity  associative  mem¬ 
ory  in  an  optical  neural  network  is  described.  The  pro¬ 
posed  architecture  is  capable  of  data  processing  at  high 
speed. 

It  is  well  known  that  optics  is  capable  of  performing  mas¬ 
sive  interconnection  in  3-D  space.  Several  optical  neural 
network  architectures  have  shown  potential  for  high  speed 
parallel  processing.  *■*  R  •cently,  the  rapid  growth  of  optical 
disk  (OD)  storage  techniques  has  provided  another  advan¬ 
tage  for  optics  in  large  capacity  information  storage  and 
processing.3  In  this  Communication,  we  propose  an  OD 
based  optical  neural  network  architecture  for  high  speed  and 
large  capacity  associative  processing. 

The  OD  stores  information  in  a  binary  form.  Two  neural 
network  models,  i.e.,  the  binary  pattern  associator  (BPA)5 
and  the  tristate  interpattern  association  (IPA)  model®  are 
suitable  for  mapping  the  interconnection  weight  matrix 
(IWM)  on  an  optical  disk.  Since  the  IWM  for  the  BPA  is  a 
binary  matrix,  it  can  be  directly  recorded  on  an  OD.  The 
IPA  model  assigns  to  each  element  [either  a  1  (i.e.,  excita¬ 
tion)  or  -1  (i.e.,  inhibition)  or  0  (i.e.,  no  relation)  in  the  1 WM) 
based  on  the  association  of  special  and  common  features 
among  reference  patterns.  Since  the  IWM  can  be  written 
into  positive  and  negative  binary  matrices  T+  and  T",  re¬ 
spectively,  T*  and  T~  can  be  separately  recorded  on  an  OD. 

Figure  1  shows  an  optical  neural  network  using  an  OD  for 
the  large  capacity  storage  of  IWMs.  In  this  figure,  a  pulse 
laser  beam  is  divided  into  two  orthogonally  polarized  beams 
by  a  polarized  beam  splitter  PBS1.  These  beams  are  direct¬ 
ed  to  the  moving  heads  scanning  on  both  sides  of  the  OD,  on 
which  T+  and  T~  can  be  simultaneously  read  out.  Thus  the 
positive  and  negati  'e  matrices  of  IWM  are  orthogonally 
polarized.  Each  moving  head  consists  of  a  mirror,  polarized 
beam  splitter,  quarterwave  plate,  and  microscopic  lens  to 
enlarge  the  readout  matrix.  The  moving  heads  trav«!  along 
the  diagonal  lines  of  the  disk  that  cover  the  most  inner  to  the 
most  outer  tracks.  Polarized  beam  splitters  PBS2  and  PBS3 
are  aligned  in  the  same  direction  as  the  incoming  beams 
Since  each  reading  beam  passes  the  quarterwave  plate  twice, 
it  rotates  the  polarization  plane  by  90®  and  is  reflected  by 


PBS2  and  PBS3.  The  readout  beams  are  then  enlarged  by 
the  microscopic  lenses  L2  and  L3,  respectively,  and  then 
superimposed  on  a  diffuser.  Notice  that  the  structure  be¬ 
hind  the  diffuser  is  basically  the  same  optical  neural  network 
as  described  in  Ref.  2. 

For  a  single  layer  neura'  network  with  N  X  N  neurons,  the 
IWM  is  a  4-D  matrix  of  N4  elements,  which  can  be  parti¬ 
tioned  into  an  array  of  N  X  N  submatrices,  and  each  subma¬ 
trix  is  of  N  X  N  size.6 

A  lenslet  array  consisting  of  N  X  N  small  lenses  is  used  to 
establish  the  optical  interconnections  between  the  IWM  and 
input  pattern,  where  a  moderate  sized  SLM  with  NX  N 
pixels  serves  as  the  input  device.  As  depicted  in  Fig  2,  the 
light  beam  emitted  for  each  9ubmatrix  from  the  diffuser  is 
imaged  by  a  specific  lens  of  the  lenslet  array  onto  the  input 
SLM.  Thus  an  N  X  N  number  of  submatrices  is  added  onto 
the  input  device.  The  overall  transmitted  light  can  be  sepa¬ 
rated  by  PBS4  and  then  imaged  at  the  output  plane  to  form 
two  N  X  N  output  arrays,  which  represent  the  product  of  the 
4-D  interconnection  weight  matrix  (i.e.,  T+  and  T~)  and  2-D 
input  pattern. 

To  form  a  closed  loop  neural  network,  the  electronic  sig¬ 
nals  from  Lwo  detector  arrays  PD  1  and  PD2  are  .ent  to  a 
parallel  electronic  postprocessing  array.  The  circuit  would 
consist  of  a  buffer,  comparator  array,  and  t  hiesholding  array. 
The  output  pattern  can  be  fed  back  to  the  input  SLM  for 
further  iterations  or  sent  to  the  microcomputer  for  decision 
making  via  an  interfacing  circuit. 

We  propose  that  a  fer,oelectric  liquid  crystal  SLM  be  used 
as  the  input  device  of  the  system.  Accordingly,  its  contrast 
ratio  can  be  as  high  as  125:  l.7  Since  the  SLM  can  be  paralle- 
ly  addressed,  the  detector  and  input  arrays  can  communicate 
in  parallel.  Thus  the  electrooptical  feedback  loop  can  be 
performed  in  a  completely  parallel  manner. 

Several  types  of  optical  disk  are  commerically  available, 
such  as  the  read-only  CD-ROM,  the  write-once  optical  disk, 
and  the  magnetooptical  erasable  disk.  Here  we  select  Opti- 
men  1000,  a  30-48-cm  (12-in.)  diam  read-only  OD,  as  an 
example,  which  can  store  as  much  as  2.05  Gbytes  of  informa¬ 
tion  on  two  sides  of  the  disk.* 

The  area  on  the  disk  surface  on  which  the  laser  beam  is 
focused  is  chosen  to  be  1  mm2.  This  is  primarily  due  to  the 
limitation  of  L2  and  L3,  the  microscopic  lenses’  field  of  view, 
in  which  the  magnification  factor  is  ~70.  An  area  of  I  mm- 
consisting  of  529  x  529  bits  can  be  used  to  3tore  the  IWM  'or 
a  23-  X  23-neuron  network.  The  configuration  of  an  Opti- 
men  1000  OD  and  the  arrangement  of  blocks  in  tracks  and 
sectors  on  the  disk  are  illustrated  in  Fig.  3.  Note  that  the 
number  of  blocks  varies  radially  in  different  sectors.  Al¬ 
though  there  is  a  slight  distortion  of  the  blocks  due  to  the 
radial  structure  of  the  disk,  it  can  be  compensated  by  either 
lenses  L2  and  L3  or  input  SLM  with  photodetector  arrays. 

To  retrieve  an  association,  the  mrving  heads  would  simply 
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Fig.  1.  Optical  disk  based  neural  network  architecture. 


Fig.  2.  Optical  arrangement  of  the  neural  network.  Fig.  3.  Optimen  1000  disk  and  the  IWM  blocks  on  disk. 


Now  let  us  consider  the  requirement  for  the  rotation  speed 
of  an  OD  driver.  The  size  of  a  pit  is  ~l  pm  on  the  OD  surface. 
The  traveling  distance  of  the  moving  heads  should  not  ex¬ 
ceed  1  fira  in  pulse  duration  (i.e.,  1  ns)  to  avoid  blurring. 
Therefore,  the  maximum  spinning  speed  of  OD  is  given  by 

V0D  ■  10-'  X  10*  X  60/(r  X  12  x  0.025)  -  63.662  rpm, 

which  well  exceeds  the  speed  of  the  commercially  available 
OD  driver  ( — 1 122  rpm).  We  shall  use  the  1122  rpm  to 
estimate  the  performance  of  the  proposed  optical  neural 
network. 

Based  on  the  above  design  parameters,  there  are  ~14,600 
blocks  of  the  529  X  529  matrix  on  each  side  of  the  OD. 
Assume  that  each  block  can  store  fifty  associations  by  using 
the  IPA  model;  there  would  be  ~730,000  associations  per 
disk.  Notice  that  this  number  is  almost  5  times  the  150,000 
entries  of  a  Webster's  Collegiate  Dictionary. 

Since  the  existent  OD  driver  spins  at  1 122  rpm,  the  reading 
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aim  at  the  right  blocks  to  capture  the  IWM  with  pulse  laser 
and  then  image  them  on  the  diffuser.  The  pulse  width  and 
power  of  the  laser  are  related  to  the  response  time  and 
sensitivity  of  the  photodetector  array.  The  response  time  of 
a  typical  photodetector  is  in  the  1-ns  range  for  which  a  pulse 
laser  in  nanosecond  width  should  be  chosen.  The  required 
power  of  tha  laser  can  be  estimated: 

ID 

where  Pi  is  the  power  of  the  laser,  Sp  is  the  sensitivity  of  the 
detector,  and  the  absorption  coefficient  i)  of  the  system  can 
be  written  a  “  0.5f  itjtj,  tt  represents  the  reflectivity  of  the 
OD,  ti  the  transparency  of  the  input  SLM,  and  t]  the  energy 
loss  factor  between  the  diffuser  and  input  device. 

We  assume,  for  example,  that  tt  »  0.5,  tj  «  0.2,  t3  ■  5  X 
10~J,  and  Sp  m  ~10-5  W;  the  laser  power  can  be  estimated  as 

PL  >  10"V(0.5  X  0.5  X  0.2  X  5  X  10'3)  -  40  mW. 
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heads  take  —45  ms  on  average  to  move  from  one  block  to 
another.  We  assume  that  the  parallel  electronic  circuit  per¬ 
forms  postprocessing  within  this  duration.  Since  each  block 
consists  of  279,841  connections,  this  yields  an  average  pro¬ 
cessing  rate  of  about 

VP  -  2  X  279,841/(45  X  10'*)  -  12.4  X  10*  connections/*. 

Compared  with  the  currently  available  electronic  processor 
(designed  for  neurocomputing)  at  —22  X  10®  connections/s,9 
the  speed  up  factor  of  the  proposed  optical  neural  network  is 
-660. 

If  we  assume  that  the  parallel  electronic  postprocessing 
can  be  completed  in  2  ms  and  the  disk  driver  can  spin  at 
—31,800  rpm  instead  of  1122  rpm,  the  processing  rate  of  the 
proposed  system  would  be  as  high  as 

Vr„„,  -  2  X  279,841/(2  X  10"*)  -  279.841  X  10*  connections/*. 

There  are,  however,  several  problems  that  should  be  ad¬ 
dressed  before  constructing  the  optical  disk  based  neural 
network. 

The  readout  head  has  to  be  redesigned  for  reading  the 
whole  block  of  an  IWM  rather  than  sequential  readout  tech¬ 
niques.10 

The  existent  SLM  still  cannot  catch  up  with  the  processing 
speed  of  the  proposed  system  (i.e.,  — 109  Hz).  However,  the 
optical  disk  based  neural  network  is  suitable  for  applications 
to  a  huge  database  associative  search,  which  does  not  require 
a  frequent  change  of  input  patterns. 

The  electronic  bottleneck  in  the  feedback  loop  may  be 
alleviated  to  some  extent  by  using  parallel  buffers.  Howev¬ 
er,  a  decision  making  circuit  for  postprocessing  the  output 
data  in  2-45  ms  has  to  be  developed. 

Nevertheless,  the  proposed  optical  disk  based  neural  net¬ 
work  offers  a  large  capacity  associative  database  for  which 
high  speed  operation  can  be  achieved. 
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ABSTRACT 

A  shadow  casting  optical  logic  array  processor  using  cascaded  pro¬ 
grammable  liquid  crystal  televisions  I LCTVs I  is  described.  We  have 
shown  that  the  lb  basic  logic  operations  can  be  easily  achieved  with  this 
technique.  A  technique  of  performing  two-level  logic  function  using  a 
modified  version  of  this  proposed  architectures  is  also  given.  We  hare 
show  n  that  any  two-level  logic  function  can  be  performed  with  this 
technique  The  e  xperimental  demonstrations  of  this  optical  symbolic  logic 
proc  essor  are  also  provided. 

I.  INTRODUCTION 

An  optical  logic  array  processor  using  shadow  casting  tech¬ 
nique  was  first  proposed  by  Tanida  and  Ichioka  (1J.  They  have 
shown  that  efficient  binary  logic  operations  can  be  performed 
with  the  parallelism  of  optics.  Subsequently,  Li,  Eichmann 
and  Alfano  [2)  have  demonstrated  a  hybrid  encoding  logic 
using  shadow  casting  for  digital  optical  computing.  A  tech¬ 
nique  of  using  polarization-encoding  for  the  shadow  casting 
logic  unit  was  reported  by  Karim,  Awwal,  and  Cherri  (3). 
Interesting  optical  space-variant  logic  array  based  on  the 
shadow  casting  principle  was  also  discussed  by  Yatagai  [4], 
Recently,  liquid  crystal  televisions  (LCTVs)  have  been 
frequently  applied  to  optical  signal  processing,  because  of 
their  low  cost  and  programmability  [5-8],  We  have  proposed  a 
symbolic  logic  processor  utilizing  cascaded  LCTVs  to  perform 
the  logic  operation  (9|,  in  which  two  input  patterns  and  the 
operational  mask  are,  respectively,  written  on  three  cascaded 
LCTVs 

In  this  paper,  we  shall  discuss  the  basic  logic  operation  as 
obtained  from  this  hybrid  optical  processor.  A  technique  to 
perform  two-level  logic  functions  based  on  this  architecture  is 
also  included.  Experimental  demonstrations  obtained  with 
this  proposed  symbolic  logic  processor  are  provided.  The 
apparent  advantages  of  using  the  cascaded  LCTVs  as  applied 
to  symbolic  logic  processing  must  be  the  low  cost  and  pro¬ 
grammability. 

II.  LCTV  SYMBOLIC  LOGIC  PROCESSOR 

A  LCTV  symbolic  logic  processor  using  the  shadow  casting 
technique  is  depicted  in  Figure  1.  A  collimated  light  which  can 
be  either  coherent  or  incoherent  light  is  used  to  illuminate 
three  cascaded  LCTVs.  Two  input  encoded  patterns  are  writ¬ 
ten  on  LCTV1  and  LCTV2,  respectively.  The  third  LCTV 
generates  the  operational  mask  corresponding  to  a  particular 
logic  operation  The  product  of  three  patterns  is  then  imaged 
onto  a  CCD  area  detector,  in  which  the  output  data  represent 
the  logic  operation  To  encode  input  logic  data,  a  binary 
pattern  is  divided  into  2x2  cells,  called  logic  units.  As  an 
example,  input  logic  units  (or  patterns)  a  and  h  are,  respec¬ 
tively.  illustrated  in  Figure  2(a)  Since  LCTV1  and  LCTV2  arc 
closely  cascaded,  the  combination  states  of  these  encoded 


input  logic  units  can  be  represented  by  the  patterns  shown  in 
Figure  2(b).  The  operational  mask  displayed  on  LCTV3  is 
depicted  in  Figure  2(c),  in  which  (a.fi.y.S)  represent  the 
switching  states  (0  or  1).  Thus,  we  see  that  the  eomplete  16 
logic  operations  can  be  easily  obtained  by  using  the  cascaded 
LCTV  technique,  as  given  in  Figure  3. 

The  experimental  demonstrations  have  been  obtained  with 
this  proposed  LCTV  architecture.  As  an  example,  (he  results 
of  the  exclusive-OR  (EOR)  logic  operation  arc  presented  in 
Figure  4.  Although,  in  principle,  a  logic  unit  can  be  encoded 
onto  2x2  LCTV  pixels,  due  to  alignment  difficulty.  8x8 
pixels  have  been  used  in  our  experiment 

III.  SYMBOLIC  LOGIC  FUNCTION  PROCESSOR 

In  this  section,  a  technique  of  performing  two-level  logic 
functions,  based  on  the  proposed  architecture  mentioned 
above,  is  described.  We  note  that  any  two-level  logic  function 
can  be  expressed  in  the  sum-of-product  form  as 

/( . x„) 
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whereto,  is  0  or  1  determined  by  the  particular  function,  v 
and  x,  are  the  logic  and  the  inverted  logic  variables,  respec¬ 
tively.  and 

m  =  n  ( it  -  2)  (la) 

To  perform  a  two-level  logic  function  as  described  in  Eq  (1 ). 
the  product  term  of  everv  two  logical  variables  must  first  be 
obtained  and  then  added  accordingly  to  the  particular  func¬ 
tion.  To  obtain  the  combinations  of  any  two  logic  variables, 
the  variable  patterns  and  operational  mask  arc  generated  into 
the  cascaded  LCTVs  as  schematically  depicted  in  Figure  5 
For  example,  each  variable  pattern  is  written  in  row  direction 
in  LCTV1,  and  in  column  direction  in  LCTV2.  respectively 
The  operational  masks  determined  by  the  required  function 
are  programmed  into  LCTV3  The  corresponding  output  light 
distribution  behind  LCTV3  must  be  the  combinations  of  two 
logic  variables  Figure  6  depicts  the  optical  setup  of  a  modi¬ 
fied  symbolic  logic  function  processor  The  basic  difference 
between  this  architecture  and  the  previous  one  is  using  a 
focusing  lens  /.,  to  integrate  the  output  intensity  from  the 
cascaded  LCTVs  It  is  therefore  apparent  that  the  logic  OR 
operation  can  be  obtained  with  this  setup  A  photocell  located 
at  the  focal  point  of  is  to  detect  the  intensity  which 
represents  the  output  logic  function  If  there  is  a  logical  "1" 
behind  LCTV3.  a  peak  can  be  delected  bv  this  photocell 
indicating  a  'T':  otherwise,  it  has  “0”  output  To  increase  the 
system  accuracy,  an  electrical  thresholding  circuit  is  used  after 
the  photocell  Since  the  output  function  is  represented  by  an 
electrical  signal,  it  can  be  directly  stored  into  the  high-speed 
memory  subsystem  of  a  microcomputer  for  further  usage 
Furthermore,  if  one  uses  high  contrast  spatial  fight  modula¬ 
tors  (LCTVs).  this  proposed  architecture  will  provide  a  possi- 
ble  method  to  perform  multilevel  logic  functions 

We  now  provide  a  couple  of  experimental  demonstrations 
obtained  with  this  proposed  architecture  Two  logic  functions 
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Flgur*  3  Representation  of  the  16  logic  operations 
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Ffgur*  4  Outputs  of  exctusive-OR  operation 
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Figure  7  Truth  tables  of  the  two  logic  functions 
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Figure  8  Operational  masks  for  (a)  function  I  ami  (h)  function  2 
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Flgur*  S  Spatial  arrangements  of  logic  variables  in  logic  function 
processor 


are  chosen  as  examples: 

/,(A.  B.C)  -  A  ®  B  4  C:  (2) 

f,(A.  B.C)  -AC+AB+  BC  (3) 

Figure  7  illustrates  the  truth  tabic  of  these  functions  With 
reference  to  the  logic  functions  of  Eqs  (2)  and  (3).  two 
operational  masks  (i.e.,  LCTV3)  for  Eqs  (2)  and  (3)  are  as 
depicted  in  Figure  8(a)  and  (b).  respectively  W'c  note  that 
CC  —  C  is  used  to  obtain  C  in  the  operational  mask  (LCTV3) 
of  f\{A,  B.C )  The  output  intensity  distributions  correspond¬ 
ing  to  the  two  logic  functions  F,  and  F;  by  using  the  input 
logic  variables  (LCTVI  and  2)  and  the  logic  operational 
masks  of  Figure  R(c)  and  (d)  (LCTV3).  respectively,  are  given 
in  Figure  9  By  detecting  the  zero-order  inlci’ <<!ics.  binary 
values  of  the  logic  functions  of  /,  and  F,  can  be  obtained. 
This  can  be  easily  done  by  thresholding  the  output  intensity 
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INPUT  t  (LCTV  1 1 


ABC  =  000  ABC  =  001  ABC  =  010  ABC  =  011  ABC=100  ABC  =  I0I  ABC=t10  ABC=nt 


INPUT2ILCTV2) 


HHi  nn  ■■■! 


ABC  =000  ABC  =  00 1  ABC  =  010  ABC  =  0t I  ABC  =  100  ABC=!0t  ABC=II0  ABC  =  III 


OUTPUT  OF  F.(AB.C) 


0  0  0  )  0111 
OUTPUT  OF  F^A.B.C) 


I  0  1)10  0  0 


Figure  9  Output  of  function  1  and  function  2  with  different  inputs 


level.  For  example,  as  shown  in  the  fourth  column,  the  output 
logic  value  of  Ft  is  measured  as  1.  with  respect  to  input 
A  -  0,  B  -  1,  and  C  -  1.  For  the  fifth  column,  the  logic 
value  of  F,  is  0,  with  respect  to  the  input  A  -  1.  B  -  0,  and 
C  —  0.  Thus,  we  see  that  any  two-level  logic  function  can  be 
performed  easily  with  this  proposed  symbolic  logic  processor. 

IV.  DISCUSSION 

Since  a  one-cell- to-one-cell  shadow  casting  relationship  is 
required  in  the  proposed  technique,  the  separation  of  the 
cascaded  LCTVs  must  be  adequately  small,  so  that  the 
diffraction  effect  from  one  cell  imaged  onto  another  cell  is 
negligibly  small,  i.e.  [10,  11], 

Z-T  (4> 

where  A  is  the  illuminating  wavelength,  Z  is  the  overall 
distance  between  LCTV1  and  LCTV3.  and  d  is  the  width  of  a 
square  cell.  In  our  experimental  demonstration  the  wavelength 
of  the  He-Ne  laser  is  A  -  632.8  nm  and  (he  width  of  the  unit 
cell  is  d  -  370  jim.  Then  the  overall  separation  of  cascaded 
LCTVs  is  required  as 

Z  «  22  cm  (5) 

In  our  experiments,  we  have  used  Z  »  5  cm,  which  is  well 
within  the  constraint  of  the  calculated  result  of  Eq.  (5).  Since 
the  transmittance  of  the  LCTV  is  rather  low  (about  10%  for 
the  Radio  Shack  Pocketvision  5),  the  overall  transmittance  of 
the  cascaded  LCTVs  would  be  about  0.1%.  Nevertheless, 
relatively  good  results  have  been  obtained  from  our  experi¬ 
ments.  The  absorption  of  the  transmitted  light  is  primarily 
due  to  the  low-quality  polarizer  used  in  the  LCTV.  Thus,  to 
improve  the  performance  of  the  LCTV,  a  high  quality  polar¬ 
izer  should  be  implemented. 

V.  CONCLUSIONS 

We  have  demonstrated  that  optical  symbolic  logic  operation 
can  be  easily  achieved  with  cascaded  low-cost  LCTVs.  Aside 


from  the  basic  16  logic  operations,  we  have  shown  that  the 
same  processor  can  perform  any  two-level  logic  function. 
Major  limitations  of  using  LCTV  must  he  the  low  resolution, 
low  contrast,  low  speed  and  low  transmittance,  which  prevents 
widespread  practical  applications.  Nevertheless,  the  low  cost 
and  programmability  of  the  LCTV  would  stimulate  some 
interest  in  the  application  of  symbolic  logic  processing  Since 
the  digital  computation  can  be  divided  into  a  scries  of  specific 
logic  functions,  perhaps  some  specialized  digital  uniprocessors 
may  be  implemented  based  on  this  proposed  optical 
processor. 
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Traveling  wove  field  effect  transistor,  wideband  integrated  amplifiers 
ABSTRACT 

This  paper  provides  a  new  possibility  of  realising  in  chip  form  wideband 
amplifiers  with  simple  wide  gale  field  effect  structures,  ht  taking  advan¬ 
tage  of  especially  designed  electrode  terminations  to  overcome  Inherent 
traveling  wave  losses.  Demonstration  of  these  properties  is  performed 
through  various  realizations  and  is  based  on  distributed  equivalent  circuit 
modelling. 

1.  INTRODUCTION 

Applicalions  of  the  (raveling  wave  concept  to  GaAs  long 
electrode  field  effect  devices  have  been  widely  studied  in  the 
past  few  years  and  have  given  rise  to  various  attempts  in  the 
range  of  microwave  functions  as  couplers,  isolators,  phase 
shifters,  modulators,  and  amplifiers  (1  —  5).  Among  all  these 
functions,  amplification  is  one  of  the  more  exciting  but  it 
presents  inherent  difficulties  due  to  the  extreme  complexity  of 
the  involved  phenomena. 

The  present  paper  provides  new  insight  on  this  topic  and 
shows  that  the  fundamental  limitation  related  to  propagation 
losses  can  be  overcome,  to  a  large  extent,  by  using  particular 
electrode  configurations  in  association  with  on-chip  imple¬ 
mented  terminal  lumped  impedances  Such  a  property  is  first 
illustrated  through  experimental  results  carried  out  with  a  test 
single  gale  structure  exhibiting  a  1  mm  gate  width.  Terminal 
impedances  of  various  kinds  are  investigated  and  optimum 
configurations  are  demonstrated  to  greatly  influence  amplifi¬ 
cation  bandwidth.  Then  these  results  are  interpreted  wilh  the 
help  of  a  simulation  using  a  distributed  circuit  small  signal 
approach  operated  with  the  SPICE  program.  Finally,  taking 
advantage  of  properties  stated  throughout  this  study,  we  ex¬ 
tend  the  application  to  moderate  gate  width  (150-300  pm) 
FETs  and  we  show,  with  especially  realised  devices,  the  possi¬ 
bility  of  achieving  directly  integrated  amplifiers  with  very  wide 
frequency  bandwidth. 

2.  TEST  STRUCTURE 

A  schematic  representation  of  the  test  structure  is  given  in 
Figure  1.  The  source  electrode  is  uniformly  grounded  Termi¬ 
nations  2  and  4.  which  correspond  to  parts  of  gale  and  drain 
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Figure  1  Schematic  diagram  of  Ihc  lest  structure  and  its  mcasure- 
ment  mounting 


Figure  2  Mask  topologies  of  the  I.  0  3.  and  0  15  mm  gate  \sidth 
structures  studied 


electrodes  that  would  be  open  ended  in  a  conventional  FET 
configuration,  are  here  connected  to  lumped  impedances  Z, 
and  Zy n  The  choice  of  the  nature  of  ihcsc  impedances  is 
performed  according  to  the  criteria  of  an  optimization  of  the 
S  parameters  ol  the  structure  considered  in  a  two  port  con 
figuration,  with  termination  I  as  input  and  termination  3  as 
output.  This  optimization  consists  of  obtaining  a  substantial 
value  for  the  maximum  available  gain  (MACil  on  the  widest 
frequency  bandwidth,  but  with  minimized  values  of  |.V,,|  and 
|Jj,(  in  order  to  keep  reasonable  aulomatching  conditions 
The  structure  has  been  realized  in  our  laboratory  with  a 
I  pm  gate  length,  a  I  mm  total  width,  and  a  3  pm  drain-source 
distance.  Its  exact  topology  is  represented  in  Figure  2  As  can 
be  seen,  its  drain  electrode  width  is  only  8  pm  in  order  to 
behave  as  a  propagation  line  The  main  characteristics  of  this 
structure  are 


g„,  m  120  mS  ( transcondtii tamo) 
T  -  -  2V  (pinch  olf  soilage) 
R,  -  35  11  (gale  resistance) 
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One  of  the  inherent  advantages  of  the  optical  computer  is 
its  niminternclive  interconnecting  capability.  The  optical 
perfect  shulfle  (PS)  which  forms  the  basis  of  such  an  inter¬ 
connection  network  is  a  useful  concept  in  optical  computer 
architecture,  decently,  proposals  of  optical  PS  have  been 
made  hv  Coodman  el  at.1  and  Murchic*  for  application  to 
VI, SI  systems  and  single-mode  optical  fibers,  respectively. 
More  recently,  l.nhmnnn  el  nl  implemented  the  optical  PS 
with  the  use  of  four  prisms.*  In  this  l.etter,  we  shall  demon¬ 
strate  that  two  sets  of  data  can  he  sluillled  using  an  optical 
spatial  lilter  An  experimental  demonstration  is  also  pro¬ 
vided. 

Originally,  the  term  PS  referred  to  a  method  of  shuflling  N 
number  of  cards  t/V  ”  2',  and  j  is  an  integer).  The  upper  half 
of  the  cards  are  removed  and  then  interlaced  with  the  lower 
half.  Examples  of  PS  applications  to  FFT  and  sorting  algo- 
rithms  have  been  discussed  by  Slone*  and  Parker.4  In  some 
applical  ions,  however,  the  use  of  other  composite  integer  (M ) 
inputs  instead  of  N  inputs  is  required.  The  perfect  interlac¬ 
ing  of  the  upper  half  of  the  M  inputs  with  the  lower  half  is 
called  (>Y«r/iO)  class  generalized  perfect  shuffle  (GPS).* 
Figure  I  shows  a  demonstration  of  Cj\(i)  (i.e.,  M  *  6).  We 
note  that  PS  is  only  a  special  case  of  the  GPS  in  the  class  of 
(iyu/jlt),  and  this  kind  of  shuflling  of  data  can  be  quickly 
achieved  by  optical  spatial  filtering.7 

The  optical  system  to  perform  the  (iyin(i)  class  GPS  is 
depicted  in  Fig.  2.  Two  sets  of  data  are  designated  bysiU.y) 
and  .«](.*, v),  which  are  separated  hy  a  distance  20  at  the  input 
plane  P,.  With  coherent  illumination,  the  complex  light 
distribution  at  the  spatial  frequency  plane  P-i  can  be  de¬ 
scribed  as 

Elp.q)  *  S, (/>,'/ I  expt-idyl  ♦  5’,(p.'/)  exp(idq).  (I) 

where  S|  (/>.</)  and  S,( />,</)  are  the  Fourier  spectra  of  the  input 
data  5|(r,y)  and  s-j(i.y),  respectively.  To  implement  perfect 
shuffle,  we  would  place  a  sinusoidal  grating  in  (he  Fourier 
plane  /'?.  We  assume  that  the  grating  formula  is 

III,,)  -  '/tll  I  ...s|p(  I  0)0., II.  121 

where  Ad  is  a  small  displacement  constant.  Thus,  the  out¬ 
put  light  field  distribution  on  P>  can  he  shown  as 

/(.,))  ■  7fi,(i,v  -  d l  t  '/t>,tti,y  t  d) 

4-  '/||x,l«.(  Ad)  t  >,!>.)■  ♦  Ad) | 

I  i. v  2d  Ad)  t  ♦  2(t  *  Ad)  CD 
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fig  1.  Dcimmstrnlion  of  G ,  .ti)  (i  e  .  M  =  8)  .  Inss  tll’S  permuta¬ 
tion:  (a)  input  dnta;  (l>|  the  shuffled  v  ersion  Tin-  nuintrers  in  smalt 
buses  represent  Lite  address  ol  .lulu 


Fig.  2.  Optical  PS  system:  s,  anil  sj,  input  dutu:  I  -  ■ ,  l.j,  lenses:  U, 
filtering  grating 
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Fig.  3  Experimental  result  uf  I  lie  .(it  OPS  I  .<  I  input  data;  (b) 
the  shuttled  v eiMi.n 
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From  the  third  term  of  Kt|.  (3),  we  see  that  S|(x,.v)  and  s-jtx.v) 
are  slightly  shifted  in  opposite  directions  along  the  V'axis.  !f 
the  incremental  shift  A/1  is  equal  to  the  separation  between 
the  processing  data,  S|  and  sj  would  he  perfectly  interlaced. 
Thus,  the  two  sets  of  input  data  would  be  perfectly  shuffled. 

In  the  experiment,  we  used  two  sets  of  English  letters  as 
input  data  fur  demonstration.  Figure  3(a)  shows  the  input 
data.  Figure  3(b)  gives  the  shuffled  data  obtained  with  the 
proposed  technique.  Note  that  t  be  input  and  output  format 
are  not  compatible.  This  will  present  no  problem  if  we  tailor 
design  either  the  input  or  output  data  system  Suppose  the 
input  hit  spot  size  is  0.1  mm,  and  (heir  spacing  in  the  X  and  Y 
directions  is  0.25  and  0  5  mm,  respectively,  an  80  X  8(lmm7 
aperture  optical  (IPS  can  shuttle  as  many  as  12,800  light 
channels.  Furthermore,  if  two  of  the  systems  are  cascaded 
in  tandem,  the  PS  operation  can  be  applied  to  a  2-1J  data 
irray.such  that  one  shuffles  horizontally  and  the  other  verti¬ 
cally.  Obviously,  the  major  disadvantage  of  the  system  is 
that  it  represents  a  negative  process.  With  a  phase-only 
sinusoidal  grating,  however,  the  energy  efficiency  can  be 
increased  to  33"  Considering  the  mussive  amounts  of  data 
it  handles,  the  (IPS  might  be  a  viable  trade  off  fur  some 
applications. 

We  acknowledge  the  support  of  the  U  S.  Air  Force  Koine 
Air  Development  Center,  Hanscum  Air  Force  Base,  under 
contract  no.  F19628-87-C-0086. 
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We  propose  here  a  new  concept  for  real  time  sensing  and 
compensation  of  atmospherically  distorted  wavefronts  using 
incoherent  broadband  sources  White  light  wavefront  sen- 

-mmii  ttiitcnlly  iincil  in  adaptive  optn.ul  system*  all  anil  ut 

measuring  a  vector  field,  the  local  wavefront  tilts  (or  wave¬ 
front  first  derivatives)  along  two  orthogonal  directions.'  We 
propose  to  measure  instead  the  local  wavefront  curvature 
pfx.y),  haplacian  of  the  wavefront  surface  z(x,y), 

<•(*■>)  ”  9  \ '  ♦  d  -  t’T,  (II 

dx!  rl\ - 


together  witli  wavefront  lilts  at  the  aperture  edge  in  a  tlirec 
tion  perpendicular  to  the  edge,  i  e  ,  for  a  circular  aperture, 
radial  tilts  at  the  edge.  Radial  tilts  provide  the  boundary 
conditions  required  to  solve  the  Poisson  Eq  ( I )  and  estimate 
the  wavefront  z(x,y),  given  the  measured  uirvaliiie  disiribu 
tion  p(x,y )  This  approach  Itus  several  advantages: 

(1)  The  wavefront  curvature  is  a  scalar  field  ll  requites 
only  one  measurement  per  sample  point  This  is  certainly 
easier  than  measuring  a  tilt  vector  field,  which  requires  mea¬ 
suring  the  two  components  of  the  till  vector  at  each  sample 
point  Indeed  we  describe  below  a  simple  optical  setup 
which  gives  both  the  local  wavefront  curvature  inside  the 
pupil  and  the  wavefront  slope  at  the  pupil  edge 

(2)  Assuming  inertial  turbulence,  the  power  spectrum  ul 

the  wavefront  surface  decreases  us  where  It  is  (lie 

wavenumber.  Hence,  the  power  spectrum  of  the  curvature 
varies  as  kin ;  it  is  almost  flat.  This  implies  I  hat  curvature 
fluctuations  at  twodiflerent  points  are  only  slightly  correlat¬ 
ed.  Since  the  process  is  Gaussian,  they  are  almost  statisti¬ 
cally  independent.  This  is  not  the  case  for  tilts  which  are 
known  to  be  highly  correlated.  Curvature  measurements 
are  therefore  expected  to  be  more  efficient  than  tilt  measure¬ 
ments. 

(3)  Perhaps  the  most  interesting  property  of  Ibis  ap¬ 
proach  is  that  membrane  or  bimorph  mirrors  can  be  used  as 
analog  devices  which  automatically  solve  the  Poisson  equa 
tion  when  proper  voltages  are  applied.  Hence  the  signal 
from  a  curvature  sensor  can  be  amplified  and  directly  ap¬ 
plied  to  the  mirror  without  any  computer  processing. 

Bimorph  and  membrane  mirrors  have  been  widely  de 
scribed  in  the  literature.  Bimorph  mirrors  are  obtained  by 
gluing  a  thin  plate  of  glass  or  any  other  polished  material  to  a 
sheet  of  piezoelectric  material  J  5  The  dynamic  equation  of 
stale  for  an  ideal  bimorph  mirror  bus  the  hirin'1 

aV 

»  dry  +  flv-V.  c.'i 

dt 2 

where  z  (x,y,f)  is  the  mirror  surface  and  is  the  volt¬ 

age  distribution  on  the  piezoelectric  sheet  as  a  function  of 
time  t;  A  and  R  are  constant  coefficients.  Membrane  mir¬ 
rors  consist  of  an  aluminum-coaled  stretched  polymer  foil. 
Deformation  is  obtained  by  means  of  electrostatic  forces  6  B 
The  dynamic  equalionof  state  for  an  ideal  membrane  has  the 
form7 

d  \  ■=  dry  ♦  HP.  t:i) 

dt7 

where  z'(x.y.f)  is  the  membrane  surface  and  /’I  t.y.O  is  the 
electrostatic  pressure  applied  as  a  function  of  l  one  /;  d  and  H 
are  again  constant  coefficients.  In  both  rases  equilibrium  is 
obtained  when  the  mirror  surface  is  the  solution  of  a  Poisson 
equation  with  appropriate  boundary  conditions  In  olher 
words,  the  effect  of  applying  a  local  voltage  or  pressure  is  to 


Fig  1  Difference  in  illumination  between  plnm-'  l‘,  ,unl  /‘  is  u 
measure  of  the  local  curvature  dislrilnilion  m  the  imoiniui:  wave 
front  IV  It  alao  measures  the  wavelrniit  rudml  till  ul  the  edge 
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An  investigation  of  using  phase  conjugate  techniques  to  remove  phase  distortion  in  a  joint  transform  correlator  (JTC)  is  pre¬ 
sented.  For  improving  the  accuracy  of  detection,  a  phase  encoding  method  based  on  the  nonlinearity  of  phase  conjugation  is  also 
proposed.  Experimental  results  and  computer  simulations  are  provided. 


1.  Introduction 

Recently,  advances  in  photorefractive  materials 
have  stimulated  interest  in  the  application  of  phase 
conjugation  techniques  to  a  number  of  signal  pro¬ 
cessing  problems  (I).  Presently,  the  phase  conju¬ 
gation  mirror,  based  on  the  self  pumped  configura¬ 
tion  [2 1  in  photorefractive  crystals,  exhibits 
reflectivities  as  high  as  70%,  while  requiring  only  a 
few  tens  of  milliwatts  of  optical  input  power.  Thus, 
this  greatly  extends  the  range  of  practical  applica¬ 
tions  of  phase  conjugation  mirrors.  In  this  paper  we 
will  explore  its  application  to  a  joint  transform  cor¬ 
relator  (JTC).  The  JTC  (3,4)  is  a  powerful  image 
processor,  particularly  for  pattern  recognition  appli¬ 
cation,  since  it  avoids  the  synthesis  and  alignment 
problems  of  a  matched  spatial  filter.  In  most  coher¬ 
ent  image  processing  applications,  the  input  objects 
are  required  to  be  free  from  any  phase  distortion.  The 
input  objects  of  a  real  time  optical  processor  are  usu¬ 
ally  generated  by  means  of  a  spatial  light  modulator 
(SLM ),  however,  most  SLMs  introduce  some  sort  of 
phase  distortion.  We  note  that  phase  distortion  can 
severely  degrade  the  correlation  characteristics  in  a 
JTC.  Although  liquid  gates  may  be  used  to  compen¬ 
sate  the  phase  distortion  to  some  extent,  they  can  only 
remove  the  external  distortion  but  generally  can  not 
compensate  the  internal  distortion  of  the  devices. 
Furthermore,  holographic  optical  elements  (HOE) 
may  provide  another  means  of  phase  distortion  re¬ 
moval  (5),  but  they  have  the  disadvantages  of  crit¬ 
ical  alignment  and  cumbersome  fabrication. 


Another  problem  common  to  the  JTC,  as  well  as 
other  coherent  correlators,  is  that  the  width  of  the 
correlation  spot  is  too  broad,  and  the  cross  correla¬ 
tion  intensity  is  too  high.  To  improve  the  accuracy 
of  correlation  detection,  the  object  functions  can  be 
pre-encoded.  The  inherent  nonlinearities  in  phase 
conjugation  may  be  used  for  this  encoding  process. 
Let  us  now  consider  a  four-wave  mixing  JTC.  as 
shown  in  fig.  I.  We  propose  the  object  beam  of  the 
four-wave  mixing  is  applied  to  the  input  of  a  JTC. 
Notice  that  this  configuration  would  have  two  major 
advantages. 

1.  The  phase  distortion  due  to  the  input  SLM  can 
be  automatically  compensated  by  the  conjugated 
wavefront. 

2.  An  additional  amplitude  or  phase  modulation 
produced  by  the  nonlinearity  of  phase  conjugation 


latvi 


Fig.  I.  Experimental  setup  BS.  Beam  splitter;  M.  mirror;  (>. 
ject;  Q,  quarter  wave  plate;  A.  analyier;  L,.  imaging  lens. 
Fourier  transform  lens;  P0.  output  plane. 
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may  provide  a  means  of  improving  the  accuracy  of 
:orrelation  detection. 


2.  Principle 

it  is  well  known  that  phase  conjugation  can  be  pro¬ 
duced  with  a  photo-refractive  crystal.  With  referring 
to  the  JTC  in  fig.  1 ,  the  readout  beam  is  adjusted  be¬ 
yond  the  coherent  length  with  respect  to  the  writing 
beams.  In  other  words,  the  setup  represents  a  two- 
wave  mixing  configuration  with  a  real-time  readout 
beam.  Notice  that  the  expanded  collimated  Ar*  laser 
beam  (2  =  0.5145  pm)  is  divided  into  three  paths. 
One  is  directed  toward  the  photo-refractive  crystal 
(BSO,  I0X  10x2  mm3)  by  mirror  M2  and  serves  as 
the  reference  beam.  The  second  is  used  to  illumi¬ 
nated  the  input  objects  O,  and  02,  which  are  imaged 
onto  the  crystal  by  lens  L,.  The  third  is  directed  by 
mirror  Ml,  M5,  M4  and  serves  as  the  readout  beam. 
The  reconstructed  beam  from  the  crystal  is  then  im¬ 
aged  back  to  the  input  objects  Oi  and  02  for  phase 
distortion  removal.  After  passing  through  the  input 
objects,  the  beam  is  then  joint  transformed  in  the 
output  plane  P0  by  lens  L2,  via  a  beam  splitter  BS3. 
We  notice  that  a  half  wave  plate  Q,  between  the  BSO 
crystal  and  mirror  M«,  is  used  to  rotate  the  polari¬ 
zation  of  the  readout  beam.  An  analyzer  A  located 
at  the  front  of  the  output  plane  is  used  to  reduce  the 
light  scattered  from  the  optical  elements  in  the 
system. 

With  reference  to  the  optical  configuration  of  fig. 
I,  the  object  beam  can  be  written  as 

0(x,y)  exp[i0(jr,  y)  J 

=  0,(x-b,y)  expli<fi,(x-b,y)1 

=  0,(x  +  b,y)  exp[ip2(x+b,y))  ,  (I) 

where  0 ,,  02,  0,  and  02  arc  the  amplitude  and  phase 
distortion  of  the  input  objects,  respectively,  b  is  the 
mean  separation  of  the  two  input  objects,  and  0,,  02 
are  assumed  positive  real.  At  the  image  plane  (i.e. 
the  crystal),  the  object  beam  is  given  by 

0(x/M,  y/M)  txp[\<p(x/M,  y/M)  | 

Xexp|ifc(jr,+y,)/2L)  ,  (2) 

where  M  represents  the  magnification  factor  of  the 


imaging  system,  L=s-f,  s  is  the  image  distance. /is 
the  focal  length  of  lens  L,,  k=2n/X,  X  is  the  wave¬ 
length  of  the  light  souicc. 

Thus,  the  reconstructed  beam  emerging  from  the 
crystal  is  given  by 

O'  (x/M,  y/M)  exp[  -\<t>(x/M, y/M) ) 

Xexpl-ifc(jrI  +  >'})/2Z.)  exp(i0(x/AT,  y/M) ). 

(3) 

Notice  that  expression  ( 3 )  does  not  represent  the  ex¬ 
act  phase  conjugation  of  expression  (2).  The  am¬ 
plitude  distribution  of  0'(x,  y)  deviates  somewhat 
from  0(x,  y),  which  is  primarily  due  to  the  nonlin¬ 
earity  of  the  BSO  crystal  [6],  A  phase  shift  0(x,  y) 
between  the  phase  conjugation  and  the  recon¬ 
structed  beam  is  also  introduced.  Later  we  will  see 
that  Q[x,  y)  is  dependent  on  the  intensity  ratio  R  of 
the  object  beam  and  the  reference  beam.  If  there  is 
no  voltage  applied  on  the  BSO  crystal,  6(x,  y )  would 
represent  a  constant  phase  of  90°. 

As  can  be  seen  in  fig.  I,  the  reconstructed  beam, 
imaged  back  on  the  object  plane,  can  be  written  as 

O'  (x,y)  exp(  -i0(x,  y)  ]  exp[i0(x,  y)  ]  (4) 

After  passing  through  the  input  objects,  the  complex 
light  distribution  becomes 

0(x,y)  0(x,y)  exp[i0(x,y)]  .  (5) 

This  expression  shows  that  the  phase  distortion  0(  t. 
y)  of  the  input  objects  can  essentially  be  removed, 
while  the  additional  amplitude  and  phase  modula¬ 
tion  due  to  the  nonlinearity  of  the  BSO  remain 

3.  Phase  distortion  compensation 

The  phase  distortion  of  the  input  objects  (i.e.  due 
to  the  SLM)  can  severely  degrade  the  correlation 
characteristics.  We  have  computer  simulated  some 
of  these  effects.  The  simulations  were  obtained  w  ith 
a  test  input  pattern  joint  correlated  with  the  same 
pattern  added  with  random  phase  noise  We  as¬ 
sumed  that  the  random  phase  noise  has  a  uniform 
probability  distribution  over  a  phase  internal  ( 
ffj.  Fig.  2  shows  a  plot  of  correlation  peak  intensity 
as  a  function  of  phase  deviation  a.  From  litis  graph, 
we  see  that  the  normalized  peak  drop  of  0.5  corrc- 
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Corral  i'on  peak  value 


Maximum  phase  deviation  (radians) 


Fij.  2.  Correlation  peak  intensity  degraded  by  phase  noise. 

XK 

a 


b  c 


Fig.  3.  Joint  Fourier  transform  spectra,  (a)  A  pair  of  input  sub¬ 
jects  with  random  noise,  (b)  Their  joint  transform  speclrum.  (c) 
The  joint  transform  spectrum  with  phase  compensation. 

sponds  to  a  phase  deviation  of  0.6  radians.  In  other 
words,  the  phase  distortion  of  a  SLM  should  not  ex¬ 
ceed  1/10  wavelength,  which  corresponds  to  0.6  ra¬ 
dians,  otherwise  the  correlation  peak  would  be  se¬ 
verely  degraded.  However,  most  SLMs  do  not  meet 
this  requirement. 

In  order  to  demonstrate  the  phase  compensation 
with  phase  conjugate  technique,  a  pair  of  input  ob¬ 
jects,  shown  in  fig.  3a,  is  added  with  a  random  phase 
plate.  Their  joint  transform  spectrum  is  shown  in  fig. 
3b.  Notice  that  the  spectrum  is  severely  corrupted  by 
the  phase  disturbances.  However,  with  the  phase 
compensation  technique,  the  spectrum,  obtained  with 
the  experimental  setup  described  in  fig.  I,  is  rela¬ 
tively  free  from  the  disturbance  as  shown  in  fig.  3c. 


Fig.  4  shows  the  correlation  spots  leconstrucied  from 
these  two  cases.  For  no  phase  compensation,  the  cor¬ 
relation  spots  are  heavily  embedded  in  random  noise, 
as  pictured  in  fig.  4a,  while  with  phase  compensa¬ 
tion,  the  correlation  spots  can  clearly  be  seen  in  fig 
4b. 

It  is,  however,  necessary  to  sticss  the  role  played 
by  the  imaging  lens  L,.  First,  lens  L,  ensures  that  all 
the  light  scattered  by  the  input  objects  can  be  di¬ 
rected  'oward  the  BSO  crystal  (assume  that  L,  has 
a  sufficiently  large  aperture.).  Secondly,  the  recon¬ 
structed  beam  is  not  the  exact  phase  conjugated 
beam,  it  has  an  additional  phase  modulation  6{x,  >). 
Thus,  it  is  apparent  that  if  no  imaging  lens  is  em¬ 
ployed,  the  light  ray  emerging  from  an  arbitrary  ob¬ 
ject  point  would  not  longer  be  reconstructed  ba'-'-  at 
the  same  point.  By  using  the  imaging  lens,  it  ensures 
that  every  light  ray  emerging  from  the  objects  would 
be  reconstructed  back.  As  long  as  all  the  light  scat- 


Fij  4  Reconstructed  correlation  spots  (a  )  Without  phase  co 
pensation  (b)  With  pi. ase compensation 
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tered  by  the  phase  distortion  of  the  objects  are  col¬ 
lected  by  the  aperture  of  Lt,  the  phase  distortion  of 
the  objects  can  be  compensated  by  this  technique. 
However,  if  the  aperture  is  not  large  enough,  the  high 
spatial  frequency  components  of  the  phase  distor¬ 
tion  could  not  be  compensated. 


4.  Pre-encoding 


The  reconstructed  beam,  as  expressed  in  eq.  (5), 
is  different  from  the  object  function  0{x,  y).  The 
additional  amplitude  and  phase  factors  within  the 
reconstructed  beam  can  be  used  for  object  pre-en¬ 
coding  in  a  JTC,  for  which  the  correlation  charac¬ 
teristics  can  be  improved.  These  factors  are  depen¬ 
dent  on  object  and  reference  beam  ratio  R  (6],  as 
defined  by 


R(x,y)  = 


Q2{x/M,  y/M) 

l. 


(6) 


where  /,  is  the  intensity  of  the  reference  beam. 

The  phase  modulation  0(x ,  y)  represents  the  phase 
difference  between  the  conjugation  of  the  object  beam 
and  the  actual  reconstruction  beam  (see  expression 
( 3 ) ).  This  phenomenon  is  due  to  the  interaction  be¬ 
tween  the  writing  beams  (7).  According  to  Vahey 
[8],  the  phase  deviation  between  the  writing  beams 
varies  along  the  propagation  within  the  crystal  and 
can  be  expressed  as 

=  (7) 

where 

Q{z)  =  2r zsin(0,) 

+  tan"'[ ( 1  -/?)/(!  +  7?)  1 ,  (8) 

r  is  the  coupling  constant,  0,  is  the  phase  shift  be¬ 
tween  the  writing  interference  pattern  and  the  in¬ 
duced  index  grating,  and  «r(0)  is  the  initial  phase  de¬ 
viation  between  the  writing  beams.  This  phase 
variation  would  produce  grating  bending  within  the 
crystal.  When  a  readout  beam  illuminates  the  crys¬ 
tal,  the  reconstructed  wavefront  from  the  bended 
volume  grating  would  have  a  phase  shift  6(x,  y)  rel¬ 
ative  to  the  conjugate  wavefront  of  the  object  beam. 
From  eqs.  (7),  (8)  and  (6),  we  notice  that  this  phase 


shift  9(x ,  >')  is  dependent  on  R  and  directly  related 
to  the  object  intensity  distribution  0(. r,  y).  There¬ 
fore  the  phase  modulation  0(x,  y)  can  be  utilized  to 
encode  the  object  functions. 

We  have  computer  simulated  the  effects  of  pre-en¬ 
coding  the  object  functions  in  a  JTC.  Fig.  5  is  the 
intensity  distributions  of  two  objects  to  be  corre¬ 
lated.  The  autocorrelation  curve  (for  the  triangle  ob¬ 
ject)  and  their  cross  correlation  curve  are  shown  in 
figs.  6(a)  and  (b),  respectively.  We  notice  that  the 
wide  autocorrelation  curve  and  high  cross  correla¬ 
tion  intensity  are  not  desirable.  However,  if  a  phase 
encoding  (assumed  linear,  that  is  0(.r,  y)xO(. r,  v) ) 
is  added  to  the  objects  the  correlation  characteristics 
are  improved  substantially,  as  shown  in  fig  7,  where 
the  maximum  encoded  phase  0,nl>  is  8  radians.  By 
comparing  fig.  6  with  fig.  7,  we  notice  that  the  width 
of  the  autocorrelation  reduces  and  the  cross  corre¬ 
lation  intensity  decreases.  Furthermore,  fig  8  illus¬ 
trates  how  the  autocorrelation  width  decreases 
monotonically  as  the  increase  of  the  linear  phase 
encoding. 

In  view  of  expression  (  5  ),  object  encoding  can  also 
be  accomplished  with  amplitude  modulation  It  is 
obvious  that  O  (x,  y)  is  proportional  to  the  diffrac- 


Fig.  5  Intensity  distributions  of  the  object  to  be  correlated 


Correlation 


Fig.  6.  Correlation  without  phase  encoding  (a)  Autocorrelation 
(b)  Cross  correlation. 
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Correlation 


Fig.  7.  Correlation  with  phase  encoding,  normalized  by  the  cross, 
correlation  peak  intensity  in  flg.  6.  The  maximum  encoded  phase 
0*.,  is  8  radians.  ( a )  Autocorrelation.  ( b )  Cross  correlation. 

Correlation  Width 


Fig.  8.  Autocorrelation  width  ( 50%  down  width )  decreases  with 
the  increase  of  linear  phase  encoding.  X  axis  represents  the  max¬ 
imum  encoded  phase  0,,,. 


lion  efficiency  n  of  the  phase  grating  within  the  crys¬ 
tal.  With  reference  to  Ochoa  et  al.  (6],  the  diffrac¬ 
tion  efficiency  7  of  the  phase  grating  in  a  photo- 
refractive  material  is  related  to  the  intensity  ratio  R 
of  two  writing  beams  as 

7(x,y)ocff,  R<  I. 
ocl/r,  R>  l  . 

Thus,  different  amplitude  encoding  may  be  accom¬ 


plished  by  controlling  the  intensity  of  the  reference 
beam,  for  example,  edge  enhancement,  which  ij  , 
desirable  pre-processing  in  a  JTC  [9],  Some  discus¬ 
sion  for  amplitude  encoding  may  be  found  in  ref.  [  5  j 

5.  Conclusion 

Several  applications  of  phase  conjugation  tech¬ 
nique  in  a  JTC  have  been  investigated.  It  is  showr 
that  phase  distortion  in  the  input  objects  (due  n 
SLM )  in  a  coherent  image  processing  system  can  l> 
efficiently  compensated  by  using  phase  conjugate 
technique.  The  additional  amplitude  or  phase  mod 
ulations  produced  by  the  nonlinearity  of  phase  cor 
jugation  can  be  utilized  to  pre-encode  the  objet 
functions,  for  which  correlation  characteristics  ca 
be  improved.  Computer  simulations  indicate  th; 
phase  pre-encoded  objects  improve  the  accuracy  < 
correlation  detection,  which  is  resulted  from  small 
autocorrelation  spots  and  lower  cross  correlation  i 
tensity.  This  encoding  technique  would  find  app 
cation  to  the  research  of  dynamic  pattern  recogi 
tion  and  robotic  vision. 
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MISSION 


of 

Rome  Air  Development  Center 


RADC  plans  and  executes  research,  development,  test  and 
selected  acquisition  programs  in  support  of  Command,  Control, 
Communications  and  Intelligence  (C*I)  activities.  Technical  and 
engineering  support  within  areas  of  competence  is  provided  to 
ESD  Program  Offices  (POs)  and  other  ESD  elements  to 
perform  effective  acquisition  of  C*I  systems.  The  areas  of 
technical  competence  include  communications,  com  mand  and 
control,  battle  management  information  processing,  ;  /.rveillance 
sensors,  intelligence  data  collection  and  handling,  .olid  state 
sciences,  electromagnetics,  and  propagation,  and  electronic 
reliability /maintainability  and  compatibility. 


